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■The  primary  objective  of  this  effort  is  to  determine  whether  a one  mile  flight 
technical  error  is  achievable  in  enroute  and  terminal  area  operations  using  various 
types  of  airborne  RNAV  equipment.  Flight  technical  error  (FTE)  is  evaluated  using 
both  controlled  cockpit  simulator  and  flight  test  experiments,  as  well  as  operational 
flight  test  experiments  in  the  existing  airspace  environment. 

Due  to  the  scope  and  magnitude  of  this  particular  component  of  the  area  navigation 
error  budget,  the  method  of  approach  in  this  analysis  is  to  use  a coordinated  concept 
of  data  collection  and  experiment  design  in  order  to  maintain  a strict  discipline  con- 
cerning commonality  of  acquired  data  such  that  data  from  one  experiment  complements 
and  cross  correlates  with  data  from  other  FTE  experiments. 

One  primary  element  of  the  coordinated  experimental  investigations  is  to  determine 
RNAV  procedural  and  operational  requirements  and  capabilities.  FTE  magnitude  and  its 
impact  on  airspace  planning,  RNAV  system  manufacturers,  RNAV  users  and  air  traffic  con- 
trollers is  analyzed  in  the  main  text  taking  into  account  the  following:  RNAV  equipment 
and  display  factors,  FTE  performance  in  turns,  performance  in  parallel  offset,  delay 
fan  and  direct  to  maneuvers,  effects  of  workload  and  airspace  utilization.  RNAV  error 
budget  element  combination  is  also  analyzed.  The  currently  used  RSS  technique  is  com- 
pared to  a modified  version  of  this  computation  which  is  more  accurate  in 
predicting  the  total  system  cross  track  error.  Appendices  A,  B,  C and  D present  de- 
tailed analyses  of  the  controlled  cockpit  simulator  tests,  airline  type  RNAV  system  ^ 
tests  and  operational  flight  tests  using  general  aviation  quality  RNAV  systems. 
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PREFACE 


The  Systems  Research  and  Development  Service  of  the  Federal  Aviation  Admin- 
istration has  undertaken  a technical  program  to  assess  the  qualitative  and  quan- 
titative impact  of  Flight  Technical  Error.  An  operational  evaluation  of  Flight 
Technical  Error  was  performed  to  assess  the  compatibility  and  attainability  of 
the  area  navigation  assumptions  and  concepts  described  in  the  FAA/Industry  RNAV 
Task  Force  Report.  This  work  was  performed  under  the  RNAV  Technical  Support 
Contract  to  Sysic  - Control,  Inc.  (Vt.),  Contract  number  D0T-FA72WA-3098,  with 
primary  responsibility  assigned  to  the  Champlain  Technology  Industries  Division. 

The  FAA  Technical  Monitor  for  this  work  was  D.  M.  Brandewie.  The  project 
manager  and  principal  author  of  this  document  was  R.  J.  Adams  of  CTI. 

The  scope  of  the  task  performed  was  quite  broad  and  included  a coordinated 
set  of  planned  flight  test  and  cockpit  simulator  experiments.  A total  of  six 
combinations  of  aircraft  types  with  varying  complexity  RNAV  systems  were  tested. 

A dedicated  cockpit  simulator  experiment  was  designed  to  coordinate  and  expand 
the  results  of  these  flight  tests.  The  degree  of  complexity  and  scope  of  this 
type  of  program  required  a high  level  of  support  from  several  individuals.  The 
following  list  summarizes  the  individuals  who  contributed  major  data  acquisition, 
reduction  and  analysis  tasks  for  this  study  and  their  affiliations. 


E.  D.  McConkey  (CTI)  - Software  support  and  route  design 

E.  H.  Bolz  (CTI)  - Data  acquisition,  reduction  and  sta- 

tistical processing  software  devel- 
opment, and  King  digital  data  processing 

M.  Hughes  (CTI)  - Denver  and  Miami  (King)  flight  test 

planning,  data  acquisition,  reduction 
and  analysis 

J.  B.  McKinley  (CTI)  - Engineering  graphics  support  and  data 

presentation  throughout  the  report 


W.  Heine  (SCI)  - Delco  enroute  and  terminal  area  data 

analysis 

A.  R.  Stephenson(SCI)  - Statistical  data  analysis  approach  for 

Delco  data 

E.  T.  Watanabe  (SCI)  - Delco  data  acquisition,  reduction  and 

statistical  processing 


\ 
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V 


R.  H.  Purse!  (NAFEC) 


Collins  experiment  design,  data  collec- 
tion, reduction  and  statistical  processing 


J.  D.  Edmonds  (UAFEC)  - Collins  test  planning,  scenario  devel- 

opment, and  flight  test  observer 

Collins  software  support,  debugging 
and  data  processing. 

Cockpit  simulator  experiment  design, 
data  collection,  reduction  and  analysis 

Butler  and  Litton  data  processing  and 
statistical  analysis 


A special  effort  was  performed  by  five  other  individuals  on  this  program. 
Mr.  Paul  Rich  (FAA)  provided  the  overall  coordination  and  guidance  necessary 
to  carry  out  this  extensive  program  in  a timely  and  cost  effective  manner. 

Mr.  D.  W.  Richardson  (CTI)  contributed  important  past  experience  in  both  tech- 
nical and  program  management  areas  to  the  success  of  this  program.  Mr.  D.  J. 
Nielsen  (CTI)  performed  an  invaluable  and  meticulous  editorial  task.  Ms.  K. 

M.  Cinefra  and  Mrs.  L.  P.  Bowen  performed  the  arduous  task  of  typing  and  re- 
typing necessary  to  produce  this  document.  A great  and  sincere  thanks  is  ex- 
tended to  each  of  these  individuals. 
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EXECUTIVE  SUMMARY 


The  analysis  of  flight  technical  error  (FTE)  becomes  increasingly  im- 
portant as  the  RNAV  implementation  process  progresses  and  as  RNAV  total  system 
accuracy  improvements  are  required  [1].  This  basic  premise  was  an  underlying 
assumption  which  led  to  the  Task  Force  recommendation  for  decreasing  the 
allowable  FTE  tolerance  enroute  between  the  first  two  RNAV  implementation 
phases  [2].  The  Task  Force  analysis  indicated  that  this  reduction  was  plaus- 
ible based  on  achievable  improvements  in  aircraft  flight  instruments,  RNAV 
equipment  requirements  and  pilot  training.  However,  the  Task  Force  did  not 
attempt  to  define  the  functional  requirements  or  the  pilot  procedures  necessary 
to  achieve  these  improvements.  It  is  the  specific  purpose  of  this  document 
to  validate  the  feas’bility  of  these  recommended  Task  Force  FTE  improvements. 

A comprehensive  investigation  of  the  qualitative  and  quantitative  aspects 
of  flight  technical  error  was  initiated.  This  investigation  included  an 
integrated  set  of  flight  tests  and  cockpit  simulator  tests  aimed  at  evaluating 
the  impact  of  FTE  on  system  a''curacy,  establishing  the  achievable  magnitude 
of  FTE  for  various  aircraft  .■  i RNAV  system  combinations  and  defining  the 
pilot  training  necessary  to  acnieve  the  reduced  level  of  FTE.  In  particular, 
the  current  analysis  was  performed  in  response  to  a request  from  the  Air 
Traffic  Service  of  the  FAA  and  the  RNAV  Task  Force  to  determine  whether  a 
one  mile  flight  technical  error  tolerance  was  achievable  using  various  types 
of  airborne  RNAV  equipment. 

For  the  purposes  of  this  evaluation,  flight  technical  error  (FTE)  is 
defined  as  the  error  incurred  in  the  manual  or  autopilot  control  of  the  air- 
craft. FTE  is  measured  as  the  observable  deflection  indicated  by  the  horizontal 
or  vertical  deviation  indicator  on  an  area  navigation  display.  Th-a  measured 
deviations  should  be  solely  attributable  to  pilot  derived  sources  such  as  im- 
perfect handling  of  the  aircraft  controls,  aircraft  dynamic  response,  uilot 
response  to  indicated  guidance,  and  procedural  errors. 

Included  in  this  study  of  FTE  is  the  explicit  determination  of  realistic 
magnitudes  for  FTE  in  the  enroute,  terminal  and  approach  flight  regimes. 

These  magnitudes  are  derived  from  statistically  sound  data  aggregations  across 
many  flights  for  a wide  variety  of  RNAV  system/aircraft  combinations.  Both 
flight  test  and  cockpit  simulator  experiments  are  utilized  as  appropriate 
data  sources.  The  data  combined  statistically  has  been  processed  to  obtain 
steady  state  results  consistent  with  the  error  tolerance  specifications  in  the 
Task  Force  Report  and  FAA  Advisory  Circular  AC  90-45A.  The  error  limits 
specified  in  these  documents  assume  a zero  mean  error  and  noncorrelated,  in- 
dependent, normally  distributed  error  budget  elements.  The  data  presented  in 
this  document  was  therefore  checked  for  each  of  these  characteristics.  Steady 
state  data  derived  from  centerline  tracking  test  results  is  the  primary  source 
of  data  used  to  determine  achievable  FTE  error  tolerances  and  total  system 
cross  track  accuracy.  "Steady  state"  indicated  that  transient  course 
deviation  data  due  to  turns,  waypoint  (p,p)  update,  OBS  changes  and  blunder 
errors  have  been  edited  from  the  statistics  prior  to  aggregation  across 
flights  for  each  test  program.  The  transient  course  deviation  data  is  separ- 
ately analyzed  in  various  sections  of  the  report.  "Centerline  tracking" 
indicates  that  FTE  magnitudes  and  total  system  accuracy  magnitudes  were  de- 
rived from  data  with  respect  to  a parent  route.  Parallel  offset  accuracy, 
turn  performance.  Delay  Fan  and  Direct  To  data  was  analyzed  separately. 
Similarly,  transient  FTE  and  accuracy  while  sequencing  waypoints  and  during 
the  execution  of  turns  was  analyzed  separately. 


In  addition  to  deriving  the  magnitude  of  FTE,  this  analysis  explicitly 
determines  the  impact  of  FTE  on  airspace  utilization  as  measured  by  tracking 
radar  and  quantitatively  defined  as  total  system  error  in  the  lateral  plane. 
Total  System  Cross  Track  (TSCT)  error  is  the  primary  quantity  which  accurately 
defines  overall  performance  of  the  RNAV  system  installed  in  an  aircraft  and 
operated  either  manually  or  by  an  autopilot.  The  basic  subdivision  of  error 
quantities  used  in  this  analysis  therefore  resolves  into  FTE,  TSCT  and  RNAV 
System  or  Navigation  Cross  Track  (NCT)  error  defined  as  follows: 

FTE  - a quantitative  assessment  of  manual  or  autopilot 
steering  performance 

TSCT  - a direct  measure  of  airspace  utilization 

NCT  - a measure  of  the  aggregate  navigation  equipment 

errors  due  to  ground  and  airborne  VOR  and  DME 
as  well  as  navigation  computer  errors 

Two  other  areas  of  investigation  with  which  this  study  is  concerned  are 
FTE  duritig  area  navigation  maneuvers  and  FTE  variation  with  system  complexity 
or  workload.  The  basic  effort  in  relation  to  these  areas  was  to  attempt  to 
scope  the  necessary  pilot  training  requirements  to  insure  consistent  and  re- 
peatable performance-  of  the  necessary  procedural  and  operational  maneuvers. 
Specifically  addressed  in  each  of  these  categories  were  differences  in  FTE 
due  to: 


Parallel  Offset  Operations  Waypoint  Storage 

Turn  Anticipation  Techniques  2D  vs  3D  Approaches 

Delay  Fan  and  Direct  To  Procedures  Manual  vs  Autopilot  Steering 

Determination  of  the  magni tides  of  all  the  RNAV  system  error  budget  ele- 
ments was  not  included  in  the  current  analysis  of  FTE.  Significant  error 
elements  such  as  VOR  scalloping,  RNAV  system  filtering  characteristics,  elec- 
tromechanical display  errors  and  omnibearing  selector  (OBS)  course  setting 
errors  are  discussed  throughout  this  analysis  and  the  impact  on  the  magnitude 
of  FTE  is  indicated.  However,  the  definition  developed  for  steady  state  FTE 
omits  the  measured  impact  of  these  error  elements  for  determination  of  achiev- 
able FTE  tolerances.  This  is  consistent  with  the  latest  FAA  Advisory  Circular 
AC  '90-45A  which  explicitly  states  that  the  term,  pilotage  error,  in  the  RNAV 
equipment  error  budget  tables  includes  only  the  flight  technical  e^ror  element. 
Other  errors  must  be  included  in  the  appropriate  airborne  equipment  error 
budget  category  [1]. 

With  reference  to  the  previous  definitions  of  error  quantities  and  scope, 
the  following  executive  summary  presents  four  categories  devoted  to  an  over- 
view of  the  work  contained  in  the  text  of  this  document.  These  include  a 
summary  of  objectives,  the  method  of  approach,  the  data  sources,  and  the 
primary  results  and  conclusions. 

1.1  OBJECTIVES 

The  primary  overall  objective  of  this  analysis  was  to  determine  whether 
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a one  mile  flight  technical  error  is  achievable  using  various  types  of  air- 
borne RNAV  equipment.  This  objective  was  evaluated  using  both  controlled 
cockpit  simulator  and  flight  test  experiments,  as  well  as  operational  flight 
test  experiments  in  the  existing  airspace  environment.  The  necessity  of  this 
evaluation  arose  due  to  a proposed  reduction  in  FTE  error  budget  values  from 
the  current  2.0  nm  for  enroute  and  1.0  run  for  terminal  area  operations  to 
1.0  nm  for  both  applications  in  the  1977  time  frame  [2]. 

The  assessment  of  FTE  required  to  satisfy  the  primary  objective  included 
implicitly  the  evaluation  of  FTE  over  a wide  range  of  experimental  variables  in 
eluding  differences  in  functional  RNAV  capabilities.  A secondary  purpose  of 
this  investigation  was  to  incorporate  such  considerations  as; 

• IFR  pilots  of  varying  experience  level 

• Aircraft  of  varying  flight  characteristics 

t Enroute,  terminal  and  approach  FTE 

• Manual  flying  vs.  autopilot  FTE 

• FTE  during  parallel  offsets 

• Turn  anticipation  and  paralleling  in  turns 

In  particular,  the  feasibility  of  turn  anticipation  (early  turn)  and  rollout 
(early  completion)  coincident  with  the  next  route  segment,  applied  in  a multi- 
ple parallel  route/tu.n  situation  typical  of  terminal  area  maneuvering  was  a 
specified  requirement  of  this  analysis. 

To  insure  the  achievement  of  both  the  primary  and  secondary  objectives, 
a subcategorization  of  flight  technical  error  considerations  was  deemed 
necessary.  From  an  analytical  viewpoint,  the  most  meaningful  discussion  of 
flight  technical  error  was  achieved  by  a discussion  of  each  of  the  RNAV 
issues  which  are  affected  by  FTE.  Beginning  with  Section  3.1,  each  of  the 
issues  is  specifically  addressed  including  FTE  quantification,  turn  perfonnance 
parallel  offset  performance,  "Direct  To"  performance,  waypoint  storage  effects, 
airspace  utilization,  error  combination  and  correlation,  workload  analysis  and 
equipment  problems. 

One  outstanding  objective  has  not  been  mentioned  at  this  point,  that  is, 
to  formulate  the  description  and  quantification  of  FTE  as  an  issue.  Actually, 
this  objective  was  not  an  original  part  of  the  FTE  investigation.  However, 
due  to  the  recent  publication  of  revised  guidelines  for  the  implementation  of 
area  navigation  (AC  90-45A  HJ)  which  eliminates  FTE  as  an  RNAV  equipment  error 
budget  variable,  it  becomes  necessary  to  specify  the  meaning  or  implication 
of  the  FTE  error  budget  value.  This  objective  is  accomplished  in  Section  3.0. 


To  summarize,  it  is  the  intent  of  the  text  material  of  this  document  to; 

1)  Quantify  FTE  for  various  types  of  airborne  RNAV  equipment  over 
a wide  range  of  experimental  variables  in  order  to  assess  the 
feasibility  of  a 1.0  nm  FTE  value. 

2)  Evaluate  the  impact  of  FTE  on  airspace  utilization  of  programmed 
route  segments,  and  parallel  offsets  and  during  turns  and  other 
RNAV  maneuvers. 
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; 3)  Establish  the  relevant  meaning  or  usage  of  FTE  for  airspace 

planning,  RNAV  procedures  specification  and  RNAV  equipment 
certification  purposes. 

!l  4)  Define  the  need  for  pilot  orientation  and  training  necessary 

! to  insure  consistent  and  reliable  performance  of  those  RNAV 

■ \ procedures  deemed  valuable  from  an  operational  viewpoint. 

I 1.2  method  OF  APPROACH 

The  basic  method  of  approach  for  this  task  was  to  analyze  the  require- 
I ments  for  the  reduction  of  FTE  proposed  by  the  Task  Force.  This  entailed  re- 

1 viewing  existing  data  applicable  to  the  magnitude  of  FTE,  establishing  a 

j coordinated  data  collection  effort  necessary  to  satisfy  the  stated  objectives 

: of  Section  1.1  and  finally,  processing  the  data  in  a consistent  and  compatible 

manner  keeping  the  primary  objectives  as  previously  stated  in  mind. 

1.2.1  Summary  of  FTE  Guidelines 

The  RNAV  Task  Force  Report  [2]  reviewed  the  navigation  requirements  for 
three  distinct  phases  of  RNAV  implementation.  The  projected  implementation 
schedule  produced  specific  conceptual  and  accuracy  guidelines  for  airspace 
planners,  equipment  manufacturers,  air  traffic  controllers  and  RNAV  users. 

The  results  applicable  to  the  current  FTE  evaluation  are  summarized  in  Table 

1.1  for  the  three  implementation  phases.  The  FTE  accuracy  tulerance  guide- 
lines were  based  on  a coordinated  industry/FAA  assessment  of  area  navigation 

' requirements  to  perform  in  the  various  flight  regions  using  ground  and  air- 

borne equipment  accuracy  limits  which  either  exist  currently  or  are  realisti- 
cally feasible.  The  reduction  in  flight  technical  error  trom  2.0  to  1.0  nm 
was  based  on  anticipated  improvements  in  airborne  equipment  including  pilot 
displays.  These  achievable  improvements  included  improved  presentation  of 
RNAV  inputs  on  aircraft  flight  instruments  and  displays,  as  well  as  improved 
maintenance  and  testing,  pilot  training,  and  improved  autopilot  designs  for 
coupled  operation.  An  integral  part  of  the  overall  method  of  approach  for 
the  investigation  of  FTE  included  specific  verification  of  the  attainability 
of  the  accuracy  tolerances  shown  in  Table  1.1,  as  well  as  a detailed  determin- 
ation of  the  relationship  between  FTE  magnitude  and  area  navigation  equipment 
variables. 


Table  1.1  Task  Force  FTE  Accuracy  Tolerances 


RNAV  Implementation 
Phase 

Phase  1 
Pre-1977 

Phase  2 
1977-1982 

Phase  3 
Post-1982 

Flight  Technical  Error 

Enroute 

2.0  nm 

1.0  nm 

1.0  nm 

Terminal 

1.0  nm 

1 . 0 nm 

1 . 0 nm 

Approach 

0. 5 nm 

0.5  nm 

0 . 5 nm 

r 
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The  equipment-related  items  mentioned  in  the  Task  Force  Report  were  specifi- 
cally included.  In  addition,  the  effects  of  display  scale  factor  (sensitivity), 
display  technique  (linear  vs.  angular),  equipment  complexity  (cockpit  workload), 
and  ATC  procedures  (cockpit  workload),  were  evaluated.  Since  the  only  area  of 
change  indicated  in  Table  1.1  was  in  the  enroute  FTE  tolerance  between  Phase  1 
and  2,  the  primary  objective  for  verification  of  the  feasibility  of  the  1.0  nm 
accuracy  tolerance  was  in  this  area.  However,  data  was  also  obtained  from  the 
operational  environment  of  the  terminal  and  final  approach  areas  to  verify 
that  the  tolerances  specified  in  these  areas  were  also  achievable. 

In  addition  to  the  FTE  guidelines  provided  by  the  Task  Force,  Advisory 
Circular  90-45A  is  the  current  FAA  document  which  specifies  approval  criteria 
for  area  navigation  systems.  In  the  context  of  this  analysis,  the  method  of 
approach  must  include  an  evaluation  of  FTE  as  described  in  the  Advisory  Circular. 
The  Advisory  Circular  states  that  the  Total  System  Error  is  used  by  airspace 
planners  and  includes  the  2.0,  1.0  and  0.5  nm  FTE  error  budget  values  combined 
in  an  RSS  fashion  with  other  specified  ground  and  airborne  errors  for  the  dem- 
onstration of  system  compliance.  As  stated  previously,  the  method  of  approach 
utilized  in  this  FTE  evaluation  includes  assessment  of  airspace  utilization  as 
indicated  by  Total  System  Error.  In  addition,  this  investigation  includes  a 
preliminary  discussion  of  the  applicability  of  the  RSS  technique  for  demonstra- 
tion of  Total  System  Error. 

1.2.2  Previous  Data  Utilized 

The  method  of  approach  utilized  in  the  current  FTE  study  included  a re- 
view and  analysis  of  the  existing  data  base  which  was  directly  applicable  to 
the  current  issues.  The  results  of  applicable  previous  experiments  were  ana- 
lyzed and  integrated  into  the  current  FTE  data  base  wherever  possible,  in 
addition  to  specifying  new  data  requirements.  Table  1.2  summarizes  data  sources 
that  were  not  an  integral  part  of  the  current  FTE  effort  but  which  provided 
inputs  required  to  answer  current  questions. 


Table  1.2  Previous  FTE  Data  Sources 


Data  Source 

Period  of  Performance 

Data  Availability 

University  of  Illinois 

1971  to  1974 
1971  to  1974 
1971  to  1974 
1971  to  1974 

FAA-RD-74-148 

FAA-RD-73-202 

FAA-RD-72-126 

FAA-RD-72-29 

Procedural  Complexity 
Display  Scale  Factor 
VNAV  Effects 

Linear  vs.  Angular  Displays 

NAFEC  (Accuracy  Data) 

Two  Waypoint  Analog  System 
Inertial  System 
Single  Waypoint  Analog 
System 

1971  to  1972 

1972  to  1973 

1973  to  1974 

To  Be  Issued 
To  Be  Issued 

FAA-RD-76-12 

A 
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1.2.3  Data  Acquisition  Plan 


Using  the  concepts  and  requi rements  introduced  by  the  RNAV  Task  Force 
Report,  and  taking  into  account  the  existing  data  base  described  in  Section 
1.2.2,  a plan  of  data  collection  was  developed  to  provide  specific  quanti- 
tative and  qualitative  answers  to  the  current  FTE  issues.  This  series  of 
coordinated  test  plans  included  cockpit  simulations,  experimental  flight  tests 
and  operational  evaluations.  Specific  coordination  was  accomplished  in  the 
design  of  experimental  routes,  data  acquisition  and  data  reduction  procedures 
for  the  various  sources  available  including  NAFEC,  the  University  of  Illinois, 
contractors  and  the  airlines.  The  primary  goal  of  this  coordinated  effort 
was  to  establish  steady  state  FTE  magnitude  in  the  enroute,  terminal  and 
approach  segments  of  flight.  These  investigations  also  included  procedural 
and  operational  evaluations  of  the  following: 

a.  Turn  Performance 

b.  Parallel  Offset  Performance 

c.  Delay  Fan  and  Direct  To  Procedures 

d.  Waypoint  Storage  Effects  on  FTE 

e.  Airspace  Utilization  and  Accuracy 

f.  RNAV  Error  Combination  and  Correlation 

g.  Minimum  RNAV  Systen,  Workload  and  Blunder  Considerations 

h.  RNAV  Equipment  Considerations 

Experiments  that  were  previously  used  to  evaluate  area  navigation  were 
generally  too  limited  in  scope,  not  coordinated  to  provide  commonality  of 
routes  and  procedures,  and  not  dedicated  to  the  total  evaluation  of  NNAV  prob- 
lems and  concepts  represented  by  items  (a)  through  (h).  In  contrast.  Table 
1.3  summarizes  the  integrated  set  of  flight  tests  and  cockpit  simulator  tests 
that  were  used  in  the  current  FTE  investigation. 

Table  1.3  Integrated  Test  Program  Sunnary  for  FTE  Evaluation 


No.FIi 

j Loc«'ion 

Progrem  Oo.«C*iv«l 

1.  Cp«'o*lo''el 

RNAV/Alrcrc^ 

1 , T«tm:nel  A'en  FT£  Do*o  lot 
Vof.Qwi  RSAV  Svt'f'”'  'Alfcrpf? 

Slagle  Woypo>nt  Twin 

37 

WA/T>£N 

2 . K^iAV  ^ unc’'  pno.  Cop'30'  i . ■ '«» 
in  on  CpP'O’ionot  E 

VvItiwovOOi"',  Digifol  Aifllrt/Turboprep  Twin 

OEN 

3.  EvcI^iption  0*  F.L'  >‘'ef  RNAV 

Mv.flwoypoin’,  O'gl'ol  Alfl Jpl 

26 

DES/ORD 

Row’ri  ond  P'ot>av<r» 

4 . Ta,n,;-c;  Arpc  R !>,/'»  W>drh  c^d 
FTE  E^'O*  Rpi.»'^">r''do'  oni 

1 3.  FligK*  Tei't. 

j RNAV/AfrcfoA  T^p« 

TVl 

1 . FTf  0'<d  Tc’ol  Syl'f*  E«ror  fvol- 
up'io"  Relo'ec  fo  Ro^^’e  gn 

1 AAjIt'iwo/poInl,  Oigllol  A'.fl;n»/TofbopfOp Twin 

W 

NAFtC 

2 . Cpn-mpno.  *y  o<  { »pr'  ■•■en'ol 

Ro,.-nt  onj  RNAV 

Two  VVoypciinI  Anolo9/Tu>tMpf«p  Twin 

4S 

NAFEC 

3.  Ty»n  A<-*  ; po'inp  Teinpfvi 

23 

NAFEC 

Co"'t>N»'*y  VI  *ir»n  Cv«r> 

A 'ipote  0"J  F'l 

1 SiAg'a  Woy;>oini  Anolog,  LigSf  Twin 

33 

NAFEC 

4,  F*E  Dv'Ing  C'’’;***  Cp«f* 

j Twr  Wtfypoint  A/iplog/LigKr  Twin 



62 

U.  oM. 
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This  test  matrix  was  designed  on  the  basis  of  a coordinated  concept  of  data 
collection  such  that  results  are  maximized  and  duplication  of  effort  is  mini- 
mized by  structuring  a set  of  compatible  test  plans  in  which  the  types  of 
data  from  one  experiment  can  be  correlated  with  all  other  experiments  and  the 
total  set  of  experimental  results  provides  a substantial  data  base  for  the 
important  issues.  Specific  program  objectives  are  listed  for  each  major 
experimental  program  such  as  operational  flight  tests.  The  group  of  test  pro- 
grams indicated  in  Table  1.3  comprise  the  basis  for  the  results  and  conclusions 
presented  in  Section  1.3,  as  well  as  the  analytical  discussion  of  the  impact 
of  FTE  presented  in  Section  3.0. 

1.3  RESULTS  AND  CONCLUSIONS 

This  section  presents  a generalized  summary  or  overview  of  the  primary  re- 
sults and  conclusions  which  may  be  found  in  Sections  4.0  and  5.0  respecti vely. 

A detailed  analysis  and  expanded  discussion  of  each  of  these  major  results  may 
be  found  in  Section  3.0  The  intent  here  is  to  provide  answers  to  the  basic 
quantitative  and  qualitative  FTE  issues  which  have  been  resolved  as  a result 
of  the  comprehensive  and  coordinated  set  of  experiments  described  in  the  method 
of  approach  (Section  2.0).  Each  quantitative  statement  contained  in  this 
summary  of  results  and  conclusions  includes  a parentheticated  reference  to  a 
table  or  figure  which  substantiates  what  is  said  using  applicable  data  from 
trie  experiments. 

The  principal  result  of  this  study  regards  the  attainable  magnitudes  of 
flight  technical  error,  FTE,  using  various  types  of  airborne  RNAV  equipment. 

It  was  found  that: 

1)  A one  nautical  mile  flight  technical  error  is  achievable  in  level 
flight  enroute  and  in  level,  climbing  and  descending  terminal  area 
operations.  A 0.5  nm  FTE  tolerance  is  achievable  for  final 
approach  (Tables  3.3  and  4.2). 

The  substantiating  results  for  this  conclusion  are  summarized  in 
Table  1.4  for  easy  reference. 


Table  1.4  Summary  of  Measured,  Two  Sigma  FTE  Tolerances 


RNAV  System 

No,  Systems 

Ai rspace 

Tested 

Enroute 

Terminal 

Approach 

-- 

Airline  Systems 

3 

0.50  nm 

0.34  nm 

0.21  nm 

General  Aviation 

2 

0.82  nm 

0.90  nm 

0.48  nm 

1 All  Systems 

5 

0.69  nm 

0.74  nm 

0.43  nm 

Task  Force 
Requirements 

- 

2.0/1 .0  nm 
Phase  1/ 
Phases  2 & 3 

1 . 0 nm 
All  Phases 

0.50  nm 
All  Phases 

In  the  process  of  planning,  executing  and  analyzing  this  FTE  data,  several 
significant  RNAV  issues  were  also  investigated.  These  more  qualitative  results 
are  summarized  in  conclusions  two  through  ten. 


1-7 


A minimum  requirement  exists  for  some  type  of  procedural  turn  antici- 
pation in  order  to  reduce  turn  overshoots  to  acceptable  levels 
(Figures  3.27  to  3.30).  The  procedural  technique  chosen  must  be 
adhered  to  closely  and  consistently  in  order  to  reduce  undershoots 
as  well  as  overshoots. 

3)  The  operational  feasibility  of  parallel  offset  operations  was  demon- 
strated, on  3,  5 and  8 nm  offsets  using  digital  RNAV  systems  and  a | 

parallel  offset  function  which  provided  a centered  needle  indication  i 

when  the  offset  was  properly  acquired.  Limited  parallel  offset  data 

using  a decentered  needle  to  maintain  a procedural  offset  was  also 
obtained.  Potential  problem  areas  with  restricted  offset  distance 
(scale  factor),  navigation  system  errors  and  blunder  potential  may 
preclude  the  acceptability  of  this  type  of  parallel  offset  capability 
using  a decentered  needle.  (Tables  4.4  and  4.5,  Figures  3.33  to 
3.35). 

4)  The  feasibility  and  operational  utility  of  the  Delay  Fan  and  Direct 
To  RNAV  maneuvers  were  acceptably  demonstrated  for  both  airline  and 
general  aviation  RNAV  systems.  (Figures  4.8  and  4.9). 

5)  Navigation  requirements  unqiue  to  RNAV  indicate  the  need  for  compre- 
hensive pilot  familiarization  and  training.  Specifically  procedural 
tutn  anticipation,  parallel  offset  flying.  Delay  Fan  and  Direct  To 
RNAV  maneuvers  should  be  integral  elements  of  RNAV  training.  This 
requirement  is  necessary  in  order  to  achieve  compatible  aircraft 
tracks  for  all  levels  of  equipment  sophistication  performing  these 

RNAV  procedures  within  the  same  ATC  environment.  i 

6)  Workload  and  blunder  frequency  data  from  the  cockpit  simulator  ex-  * 

periment  indicates  a two  waypoint  system  is  preferable  to  a single 

waypoint  system  for  terminal  area  operations  (Figure  4.12). 

7)  A considerable  reduction  in  overall  blunders  as  well  as  a significant 

improvement  in  procedural  accuracy  occurred  during  general  aviation  • 

testing  over  the  first  three  to  five  RNAV  flights  by  each  experimental 
subject  pilot.  This  is  indicative  of  the  preliminary  flight  training 
and  familiarization  requirements. 

8)  Workload  and  blunder  data  analysis  supports  the  requirement  for  well 

defined  RNAV  procedures  when  sequencing  waypoints  and  when  inter- 
cepting a VNAV  glideslope  (Table  3.41  and  Figure  4.16).  * 

9)  The  RSS  error  combination  technique  was  found  to  be  overly  conser-  » 

vative.  Evidence  of  error  correlation  between  FTE  and  other  error  * 

sources  was  obtained  for  several  levels  of  RNAV  equipment.  (Figures 

4.14,  4.15  and  3.63). 

10)  RNAV  total  system  accuracy  is  within  current  specified  limits  for 

enroute,  terminal  and  approach  airspace  (Tables  4.7  and  4.8).  j 
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2.0  METHOD  OF  APPROACH 

Flight  Technical  Error  can  be  defined  as  the  inaccuracy  introduced  by  the 
pilot  in  his  attempts  to  control  the  aircraft  manually.  This  inaccuracy  is 
quantified  by  the  difference  between  the  indicated  aircraft  position  and  the 
desired  position  on  the  cross  track  deviation  indicator  (CDl)  or  horizontal  sit- 
uation indicator  (HSI).  This  inaccuracy  or  error  is  due  primarily  to  imperfect 
human  interface  with  the  aircraft  controls,  as  measured  by  the  deviation  from 
desired  position.  For  example,  deterioration  in  aircraft  heading  control  while 
examining  the  RNAV  chart  for  waypoint  update  information  is  a common  cause  of 
deviation  from  the  current  desired  RNAV  track.  This  deviation  is  reflected  in 
an  almost  immediate  displacement  of  the  GDI  needle,  which  indicates  precisely 
the  magnitude  of  the  flight  technical  error.  Flight  technical  error  (FTE)  has 
been  referred  to  as  "pilotage  error"  in  previous  area  navigation  documentation 
from  the  Radio  Technical  Commission  for  Aeronautics  (RTCA)  and  in  FAA  Advisory 
Circular  90-45  which  provides  guidelines  for  the  implementation  of  area  naviga- 
tion within  the  U.S.  National  Airspace  System.  Pilotage  error  implies  a more 
general  source  of  error  which  includes  FTE.  Although  this  has  been  the  case  in 
the  RTCA  documents  (DO  140  and  DO  152),  the  latest  revision  to  the  advisory  cir- 
cular (AC  90-45A)  explicitly  states  in  Appendix  C Section  (3)  that  the  term 
"pilotage  error"  in  the  RNAV  equipment  error  budget  tables  includes  "ONLY  THE 
FLIGHT  TECHNICAL  ERROR  ELEMENT". 

AC  90-45A  differentiates  between  FTE  and  "manual"  errors.  Manual  insertion 
errors  are  due  to  the  human  interface  with  some  type  of  area  navigation  control 
and  display  units.  Manual  data  interpretation  and  insertion  errors  that  affect 
the  performance  of  an  RNAV  operation  include  undetected  errors  such  as  inaccu- 
racies in  track  determination  (either  misreading  the  chart  or  transposing  digits 
on  track  setting)  and  similar  errors  in  inputting  waypoint  bearing  and  distance 
information.  The  resulting  RNAV  track  defined  from  erroneous  inputs  leads  to 
deviations  from  the  defined  RNAV  flight  plan  even  if  pilotage  or  FTE  is  nearly 
zero.  These  input  errors  are  usually  recognized  and  corrected  before  causing 
deviations  from  the  desired  track  which  exceed  route  width  or  protected  airspace 
limits.  This  type  of  manual  error  is  referred  to  as  a "procedural"  error.  How- 
ever, if  unrecognized  and  left  uncorrected,  procedural  errors  can  develop  in 
magnitude  to  a point  where  they  are  considered  blunders. 

Blunder  errors  are  considered  as  a gross  error  in  human  judgment  or  atten- 
tiveness that  cause  the  pilot  to  stray  significantly  from  the  desired  area 
navigation  flight  plan.  For  quantification  purposes,  "significantly"  will  be 
defined  as  exceeding  route  width  or  protected  airspace  limits. 

The  explicit  distinction  has  been  made  in  AC  90-45A  between  two  types  of 
human  interface  errors;  FTE,  or  pilotage  errors,  and  manual  errors.  Manual 
errors  are  further  subdivided  into  procedural  and  blunder  error  categories. 

Each  of  these  classes  of  human  interface  errors  is  handled  differently  for  RNAV 
system  certification  purposes.  Pilotage  error  (FTE)  is  an  explicit  error  bud- 
get element  to  be  used  by  the  RNAV  system  designer  and  the  airspace  planners  in 
conjunction  with  the  "fix  displacement  area"  tables  of  AC  90-45A  Appendix  D. 

FTE  should  also  be  included  in  designating  RNAV  procedures  for  enroute,  terminal 
and  approach  airspace.  Manual  errors  classified  as  procedural  must  be  included 
in  the  airborne  equipment  error  budget  as  specified  in  AC  90-45A  Appendix  C (3). 
Manual  errors  classified  as  blunders  are  not  included  in  the  area  navigation 
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system  error  budget.  However,  blunder  tendency  is  an  important  system  design 
and  airspace  planning  consideration. 

Aircraft  control  dynamics,  wind  velocity  and  shear,  and  air  turbulence  are 
all  environmental  considerations  which  affect  pilotage  (FTE).  In  addition,  equip- 
ment design  characteristics  such  as  filtering  techniques,  display  scale  factors 
and  display  type  (linear  or  angular)  must  be  considered  in  arriving  at  empirical 
values  for  pilotage  error  budgets.  Finally,  pilot  experience,  RNAV  training, 
pilot  workload  and  RNAV  procedural  complexity  will  all  impact  the  assessment  of 
FTE  in  the  operational  environment.  Evaluation  of  area  navigation  equipment 
currently  indicates  that  FTE  is  linear  in  nature  and  values  of  2.0  nm,  1.0  nm 
and  0.5  nm  are  typical  for  enroute,  terminal  and  approach  applications  respectively. 
The  flight  tests  and  simulation  results  presented  in  this  analysis  of  FTE  will 
assess  not  only  these  current  error  budget  values  but  will  also  carefully  examine 
the  reduction  in  FTE  proposed  by  the  RNAV  Task  Force.  The  specific  questions  to 
be  addressed  in  this  investigation  are  therefore:  (1)  Is  a 1.0  nm  FTE  error  bud- 
get value  attainable?  and  (2)  How  is  the  empirically  derived  FTE  value  utilized? 

The  first  question  can  be  resolved  by  straightforward  test  planning,  data 
acquisition  and  data  reduction  of  a comprehensive  set  of  FTE  evaluations  over 
consistent  and  realistic  flight  profiles  using  various  ai rcraft/RNAV  system  com- 
binations. This  evaluation  must  include  as  an  integral  element  the  assessment 
of  procedural  and  operational  constraints.  Such  constraints  include  turn  anti- 
cipation requirements,  parallel  offset  operational  utilization  and  waypoint  stor- 
age requirements  as  well  as  the  remainder  of  the  considerations  previously  dis- 
cussed in  Section  1.2.3  page  1-6.  The  specific  program  used  for  the  present 
evaluation  will  be  described  in  the  remainder  of  this  introduction. 

The  second  question  is  more  subjective  in  nature  and  has  no  absolute 
answers.  However,  the  approach  taken  in  this  analysis  is  to  rely  on  a literal 
interpretation  of  the  current  FAA  guideline  for  RNAV  implementation.  Flight 
technical  error  budget  values  are  listed  in  AC  90-45A  Appendix  A Section  2. a. (4) 
for  utilization  in  compliance  demonstration  for  certain  types  of  RNAV  systems. 
Specifically,  2D  RNAV  systems  not  using  VOR/DME  for  continuous  navigat.on  infor- 
mation must  include  FTE  in  the  airborne  equipment  accuracy  determination  (Section 
2. a.  (3))  and  2D  RNAV  systems  which  use  VOR/DME  information  from  other  than  the 
"Reference  Facilities"  must  either  include  FTE  and  meet  the  accuracy  limits 
specified  in  Section  2. a. (3)  or  exclude  FTE  and  meet  the  accuracy  limits  of 
Table  1,  Appendix  A of  AC  90-45A.  Finally,  "2D  RNAV  systems  using  Reference 
Facility  for  continuous  navigation  information"  must  demonstrate  compliance  of 
airborne  equipment  with  the  accuracy  limits  of  Table  1 Appendix  A which  specify 
zero  "pilot"  error. 

For  the  purpose  of  the  following  analysis,  FTE  must  be  included  in  the 
accuracy  assessment  of  area  navigation  for  the  purposes  of  airspace  planning, 

RNAV  procedure  specification  and  RNAV  system  design.  It  is  necessary,  therefore, 
to  not  only  quantify  FTE,  but  also  to  determine  the  impact  or  relationship  of 
FTE  to  total  system  accuracy.  Once  these  two  goals  have  been  achieved,  it  is 
necessary  to  specify  the  most  representative  analytical  technique  for  combining 
FTE  with  other  ground  and  airborne  errors  to  achieve  a calculated  total  system 
error  consistent  with  measured  performance. 

Using  the  referenced  AC  90-45A  RNAV  system  compliance  techniques  leads  to 
a special  case  for  the  accuracy  assessment  of  area  navigation  systems  which  must 
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comply  with  the  Appendix  A Table  1 accuracy  tables.  These  systems  d,o  not  in- 
clude FTE  as  an  error  budget  element.  The  system  certification  procedure 
specifies  the  VOR  and  DME  ground  station  error  components,  specifies  the  RSS 
error  combination  technique  and  specifies  the  total  VOR/DME/TACAN  station  re- 
ferenced accuracy  limits.  The  system  designer  is  restricted  in  his  ability  to 
"trade-off"  FTE  with  the  other  airborne  RNAV  error  elements.  This,  in  effect, 
tightens  the  airborne  equipment  error  tolerances.  The  advantages  and  disadvan- 
tages of  this  special  case  of  compliance  will  be  discussed  in  subsequent  sec- 
tions along  with  the  detailed  analysis  of  the  impact  of  FTE  on  airspace  utili- 
zation and  error  budget  considerations. 

The  preceding  discussion  illustrates  the  complexity  and  direction  of  the 
FTE  investigation  presented  in  the  following  report.  It  can  be  seen  that  the 
impact  of  FTE  directly  affects  the  airspace  planner,  the  RNAV  system  manufac- 
turer, the  RNAV  users  and  the  air  traffic  controllers.  Due  to  the  scope  and 
magnitude  of  this  particular  component  of  area  navigation  error  budgets,  a 
coordinated  concept  of  data  collection  and  experiment  design  was  utilized  to 
maintain  a strict  discipline  concerning  commonality  of  acquired  data  such  that 
data  from  one  experiment  complements  and  cross  correlates  with  data  from  other 
FTE  experiments.  A primary  element  of  the  coordinated  effort  and  the  experi- 
mental investigations  was  to  investigate  RNAV  procedural  and  operational  re- 
quirements and  capabilities.  The  remainder  of  this  introduction  concentrates 
on  this  overall  philosophy  of  experimental  design.  Section  2.1  describes  the 
specific  procedures  and  concepts  evaluated  to  develop  the  operational  constraints 
on  FTE  which  must  be  required  to  support  RNAV  in  enroute,  terminal  and  final 
approach  airspace.  Sections  2.2,  2.3  and  2.4  describe  the  detailed  flight  pro- 
file definition,  data  acquisition  and  data  reduction  procedures  which  were 
applied  to  this  assessment  of  flight  technical  error.  The  main  portion  of  this 
analysis  of  FTE  is  contained  in  Section  3.0.  This  section  is  subdivided  into 
the  main  functional  elements  required  to  support  area  navigation.  The  specific 
elements  discussed  and  the  subsection  location  are  listed  below: 


FTE  ISSUES 


Subsection 


FTE  Quantification  and  Interpretation  3.1 

Turn  Performance  3.2 

Parallel  Offset  Performance  3.3 

Delay  Fan  and  Direct  To  Procedures  3.4 

Waypoint  Storage  Effects  on  FTE  3.5 

Airspace  Utilization  and  Accuracy  3.6 

RNAV  Error  Combination  and  Correlation  3.7 

Minimum  RNAV  System  Workload  and  Blunder 
Considerations  ‘ 3.8 

RNAV  Equipment  Considerations  3.9 
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2.1  PROCEDURAL  AND  OPERATIONAL  EVALUATION 

An  important  part  of  the  integrated  flight  test  and  cockpit  simulator  eval- 
uation of  FTE  was  the  investigation  of  the  functional  capabi 1 i ties  necessary  to 
support  RNAV  operations.  In  order  to  anticipate  and  resolve  RNAV  implementation 
problems,  it  was  necessary  to  carefully  select  and  integrate  the  experiment  de- 
signs and  data  collection/reduction  to  include  a substantial  amount  of  opera- 
tional and  procedural  testing.  The  key  FTE  issues  investigated  to  provide  these 
results  were  summarized  in  the  previous  section  and  referenced  to  specific  sub- 
sections (3. 1-3.9)  of  this  report.  The  purpose  of  this  section  is  to  more 
explicitly  define  what  the  individual  operational  testing  included  and  what  types 
of  results  can  be  found  within  a discussion  of  these  operational  issues. 

The  performance  of  RNAV  equipped  aircraft  when  executing  turns  was  one  of 
the  most  important  operational  considerations.  Although  turn  performance  with 
RNAV  is  no  more  difficult  than  current  VOR/DME  navigation  around  turns,  several 
considerations  unique  to  area  navigation  implementation  result  in  a requirement 
for  more  reliable  and  consistent  turn  performance.  These  considerations  include: 

a)  Proposed  route  width  reductions  both  enroute  and  in  the 
terminal  area 

b)  Improved  FTE  requirements  enroute 

c)  Parallel  offset  operations  which  continue  around  turns 

d)  Large  variations  in  available  RNAV  system  capabilities 

e)  No  specified  functional  requirement  for  turn  anticipation 
at  this  time 

The  experiments  performed  as  a part  of  this  FTE  evaluation  were  designed 
to  thoroughly  investigate  turn  performance  and  turn  anticipation  requirements 
keeping  in  mind  the  above  operational  considerations.  The  particular  experi- 
ments performed  were  designed  to  not  only  resolve  the  question  of  allowable 
FTE  magnitude  during  turns,  but  also  to  determine  the  interrelationships  be- 
tween turn  performance  and  various  techniques  for  turn  anticipation.  The  goal 
of  this  testing  and  evaluation  was  to  develop  specific  recommendations  for  min- 
imum acceptable  turn  performance.  The  primary  evaluation  criteria  utilized 
was  the  amount  of  airspace  required  on  both  the  inside  and  outside  of  a wide 
range  of  turn  magnitudes.  The  former  is  referred  to  as  undershoot  and  the  lat- 
ter as  overshoot  airspace  requirements.  It  is  of  equal  importance  to  quantify 
and  constrain  turn  airspace  on  both  sides  of  the  turn. 

The  specific  functional  type  of  tests  used  for  the  evaluation  of  turn  per- 
formance included:  an  assessment  of  airspace  required  without  any  type  of  turn 

anticipation  compared  to  airspace  required  using  a specified  method  of  procedural 
turn  anticipation;  comparison  of  procedural  turn  anticipation  to  a form  of  auto- 
matic turn  anticipation;  evaluation  of  automatic  turn  anticipation  in  both  man- 
ual and  autopilot  controlled  flight. 

Another  important  procedural  and  operational  issue  evaluated  during  this 
FTE  investigation  was  parallel  offset  operations.  The  parallel  offset  maneuver 
is  ideally  suited  to  facilitate  a reduction  in  radar  vector  requirements  in  both 
enroute  and  terminal  area  airspace.  Several  area  navigation  manufacturers  have 
provided  a discrete  parallel  offset  functional  capability  while  several  others 
have  not.  The  desirability  and  feasibility  of  this  RNAV  maneuver  from  an  oper- 
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ational  viewpoint,  therefore,  produced  a requirement  to  evaluate  the  need  for 
such  a functional  requi reinent . The  evaluation  performed  during  the  current 
effort  included  an  assessment  of  the  increase/decrease  of  FTE  during  parallel 
offset  operations  as  well  as  definition  of  the  airspace  required  to  perform 
the  offsets.  Both  airline  quality  RNAV  systems  which  provide  the  parallel  off- 
set function,  and  minimum  capability  systems  which  do  not  were  tested.  In 
addition,  the  interaction  of  waypoint  storage  capability  and  parallel  offset 
tracking  accuracy  was  investigated.  Finally,  an  attempt  was  made  to  evaluate 
and  define  the  precise  procedures  required  when  a parallel  offset  instruction 
is  received  from  the  air  traffic  control  lei'. 

The  third  area  of  operational  importance  which  was  investigated  was  the 
utilization  of  the  Task  Force  concepts  of  the  Delay  Fan  and  Direct  To  RNAV 
procedures.  The  primary  objective  in  evaluating  these  two  procedures  was  to 
determine  the  acceptability  and  method  of  utilization  for  these  two  area  navi- 
gation procedures  from  both  pilot  and  controller  viewpoints.  The  evaluation 
performed  included  both  airline  equipment  and  general  aviation  equipment.  The 
former  provides  discrete  functional  capability  for  the  Direct  To  while  the  lat- 
ter requires  specified  pilot  procedures.  Since  the  Direct  To  procedure  is  the 
normal  means  of  terminating  a Delay  Fan,  these  two  operations  were  evaluated 
in  integrated  flight  test  experiments.  The  primary  utilization  of  these  man- 
euvers is  in  the  terminal  area.  Consequently,  the  investigation  performed  was 
limited  to  this  airspace  environment.  The  primary  objective  of  this  particu- 
lar investigation  was  to  determine  the  required  pilot  procedures  necessary  to 
result  in  consistent  performance  of  the  Delay  Fan  and  Direct  To  maneuvers. 

Another  primary  area  of  concern  in  the  operational  and  procedural  evalua- 
tion was  the  cockpit  workload  and  blunder  potential  inherent  in  executing  the 
specified  RNAV  maneuvers.  Both  flight  testing  and  cockpit  simulation  testing 
included  monitoring  and  evaluating  the  pilot  procedures,  associated  workload 
and  resultant  procedural  or  blunder  errors.  RNAV  system  complexity,  waypoint 
storage  capability  and  other  equipment  considerations  such  as  display  type 
were  evaluated  with  respect  to  the  impact  on  FTE  and  on  feasible  RNAV  operations. 

To  summarize,  the  four  main  RNAV  operational  constraints  evaluated  were 
turn  performance,  parallel  offset  operations.  Delay  Fan  procedures  and  Direct 
To  performance.  Several  levels  of  RNAV  system  complexity  were  tested  in  air- 
craft types  representative  of  user  applications.  An  evaluation  of  associated 
cockpit  workload  and  blunder  tendency  was  a fifth  operational  consideration 
evaluated  during  all  of  the  functional  and  procedural  RNAV  testing.  The  oper- 
ational importance  derived  from  this  aspect  of  the  FTE  testing  was  the  precise 
definition  of  pilot  procedural  training  required  for  consistency  in  RNAV  oper- 
ations. 

The  following  sections  discuss  in  detail  the  specific  flight  profiles 
used,  the  data  acquisition  and  reduction  processes  and  the  data  analysis  tech- 
niques employed  in  evaluating  all  of  the  procedural  and  operational  elements 
both  quantitatively  and  qualitatively. 

2.2  FLIGHT  PROFILE  DEFINITION 

The  critical  issue  to  be  kept  in  mind  during  the  planning  phase  of  any 
experimental  program  is  to  maintain  a strict  discipline  concerning  data  com- 
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monality  in  order  to  allow  extrapolation  and  cross-correlation,  as  mentioned 
previously.  Commonality  in  this  case  does  not  include  commonality  of  equip- 
ment, since  different  equipment  must  of  necessity  be  evaluated  in  order  to 
establish  differences  between  pilot  performance.  The  commonality  which  must 
be  maintained  for  an  FTE  investigation  refers  to  the  more  ATC  environment- 
oriented  issues,  such  as  commonality  of  routes  (both  enroute  and  terminal  area), 
commonality  of  procedures  (both  pilot  and  controller),  commonality  of  the  data 
acquisition  concept  (parameters,  sampling  rate,  accuracy  levels,  etc.)  and 
finally  the  commonality  as  far  as  the  techniques  of  data  analysis  are  concerned 
so  that  the  same  assumptions,  ground  rules,  compromises,  etc.,  are  applied 
wherever  possible  to  each  of  the  data  sources  that  are  used  to  establish  this 
broad  data  base.  This  section  describes  the  specific  RNAV  SID/STAR  routes  util- 
ized during  several  of  the  flight  technical  error  experiments.  The  basic  test 
routes  were  developed  using  the  NAFEC  airport  and  instrumentation  range  facili- 
ties as  a reference  since  a majority  of  the  RNAV  flight  testing  was  performed  at 
NAFEC.  The  airspace  design  that  was  utilized  was  developed  using  the  terminal  area 
routes  developed  for  the  New  York-Kennedy  terminal  area  as  described  in  "Terminal 
Area  Design  Analysis  and  Validation  of  RNAV  Task  Force  Concepts",  FAA-RD-76-194, 
October  1976. 

A diagram  of  the  1977  design  for  the  New  York  Southwest  traffic  flow  is 
shown  in  Figure  2.1.  This  traffic  flow  was  superimposed  on  a map  of  the  NAFEC 
area  with  Runway  22  at  New  York  - Kennedy  corresponding  to  Runway  4 NAFEC  (ap- 
proximately 180°  rotation).  Runway  4 at  NAFEC  was  selected  due  to  the  avail- 
ability of  an  Its  (in  order  to  test  RNAV/ILS  transitions)  and  because  Runway  4 
has  no  Restricted  Area  problem  like  that  of  Runway  22.  The  Kennedy-NAFEC  over- 
lay is  shown  in  Figure  2.2.  Kennedy  - Boston  traffic  would  use  JOOl  (arrivals) 
and  JlOl  (departures)  Kennedy  - Chicago  would  use  JI02  (departures)  and  JOO'i 
(arrivals)  or  J201  (arrivals).  Routes  J002  and  J003  are  routes  which  would 
have  relatively  low  traffic  densities,  i.e.,  used  primarily  by  unpressurized 
aircraft.  Kennedy-East  Coast  traffic  would  use  J005  and  J006  (arrivals)  and 
J103  or  J104  (departures).  It  can  be  seen  from  Figure  2.2  that  routes  JOOl, 

JlOl,  J004,  J103  and  J006  can  be  utilized  at  NAFEC  with  no  particular  modif- 
ication other  than  modifying  a couple  of  headings  in  the  terminal  area  (Routes 
JlOl  and  J004)  in  order  to  transition  smoothly  between  arrival  and  departure 
segments . 

Figure  2.3  illustrates  four  basic  route  profiles  tested.  The  routes  were 
designed  to  accommodate  aircraft  of  various  types  but  maintaining  route  circuit 
time  to  50-60  minutes.  Each  circuit  includes  enroute,  terminal  area  and  approach 
segments  to  satisfy  FiE  data  acquisition  reqiji rements  for  each  flight  regime. 

Areas  between  route  segments  F,  G and  H are  we^l  suited  to  the  "trombone" 
maneuver  while  areas  between  Y,  V,  G and  M,  F,  G can  be  easily  used  for  delay 
fans.  Impromptu  waypoints  can  be  utilized  by  cutting  corners  at  several  loca- 
tions such  as  proceeding  direct  from  point  D to  F rather  than  flying  from  D to 
E to  F or  by  going  from  V to  H rather  than  V G H.  Holding  pattern  areas  that 
generally  correspond  to  those  currently  used  at  JFK  were  incorporated  into  the 
design.  These  may  or  may  not  be  used  at  the  discretion  of  the  controller  in- 
volved in  each  experiment. 

Routes,  A,  B,  C,  D,  E,  F,  G,  H,  J and  A,  B,  R,  S,  T,  U,  V,  G,  H,  J are 
referred  to  as  A-1  and  A-2  respectively.  These  routes  were  designed  for  flight 
test  experiments  using  the  King  KN74  and  the  Air  Data  RNAV  systems  in  a light 
twin  aircraft  (Aero  Commander  500  and  680  respectively).  These  routes  will  also 
be  used  in  the  cockpit  simulator  evaluation  of  the  KN74  at  NAFEC  in  a GAT-2  . 


NEW  YORK  TERMINAL  AREA  1977 
SovjfKwesi  Flow  77-01-01 


Figure  2.1  1977  Hew  York  Terminal  Area 


Figure  2.2  N.Y.  Terminal:  jFK  SW  Flow  Centered  on  NAFEC 
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Routes  A,  B,  C,  K,  L.  M,  F,  G,  H,  J and  A,  B,  R,  S,  T,  W,  X,  Y,  V,  G,  H, 

J are  referred  to  as  B-1  and  B-2  respectively.  These  routes  were  designed  for 
flight  test  experiments  using  the  Collins  ANS-70A  and  the  EDO  RNAV  systems  in 
a heavy  twin  aircraft  (Gulfstream  1).  These  routes  were  also  used  by  the  Uni- 
versity of  Illinois  in  a GAT-2  to  evaluate  parallel  offset  capability  and  turn 
anticipation  techniques.  In  subsequent  tests,  the  B routes  will  be  used  by  a 
GAT-2  with  an  EDO  RNAV  system. 

Of  equal  importance  to  route  profile  design  is  the  establishment  of  a set 
of  priorities  for  the  levels  of  information  required  and  matching  the  issues  of 
importance  to  the  requirement  to  acquire  the  data  necessary  to  resolve  RNAV 
implementation  issues.  If  the  cockpit  simulator  could  adequately  be  used  to 
establish  levels  of  flight  technical  error,  as  opposed  to  flight  testing,  the 
cockpit  simulator  was  used.  However,  in  certain  circumstances  the  operational 
environment  of  a flight  test  is  a necessary  element  in  the  ultimate  extrapo- 
lation of  data  acquired  from  other  sources.  It  is  for  these  reasons  that  this 
evaluation  of  flight  technical  error  is  organized  consistent  with  the  primary 
FTE  issues.  These  issues  include  steady  state  FTE,  FTE  and  system  accuracy 
during  turns,  parallel  offset  performance,  waypoint  storage  effects  and  error 
combination  considerations.  It  is  also  for  these  reasons  that  the  route  pro- 
files used  in  the  various  flight  testing  and  simulator  testing  be  compatible. 
Specifically,  it  is  important  to  ensure  commonality  of  turn  magnitude  and  di- 
rection, duration  of  each  route  segment  (common  workload/boredom  effects  with 
various  aircraft/RNAV  system  combinations)  and  commonality  of  aircraft  speed  and 
altitude  control  workload  in  order  to  evaluate  FTE  results  in  a compatible  manner. 
To  summarize,  the  A and  B routes,  as  described,  attempt  to  accomplish  all 
of  the  above  for  the  current  tests.  In  addition,  these  profiles  were  derived 
from  a realistic  operational  route  design  applicable  to  the  New  York  Terminal 
Area  in  the  1977  area  navigation  environment.  This  latter  consideration  ensures 
compatibility  with  operational  FTE  and  workload  analysis  using  data  obtained 
on  published  RNAV  SID  and  STAR  routes  in  actual  terminal  area  environments. 

2.3  DATA  ACQUISITION  AND  ANALYSIS 

In  order  to  achieve  the  various  FTE  objectives  outlined  in  Section  1.1,  it 
was  necessary  to  record  a certain  minimum  set  of  airborne  and  ground  reference 
navigation  data.  Although  the  entire  ETE  evaluation  effort  included  a wide  var- 
iety of  RNAV  systems  and  data  recording  capabilities  (see  Table  1.3),  there 
was  a minimum  specified  data  recording  requirement.  Table  2.1  lists  the  mini- 
mum airborne  data  recording  requirements  and  the  actual  track  reference  data 
recording  system  used  for  each  of  the  types  of  flight  tests  and  cockpit  simu- 
lator tests  that  provided  data  for  this  evaluation  of  flight  technical  error. 

The  primary  data  used  for  determining  actual  aircraft  flight  profile  was 
tracking  radar.  The  operational  tests  performed  in  the  Miami,  Chicago  and 
Denver  terminal  areas  used  ARTS  III  radar  tracking.  The  enroute  data  taken  in 
the  high  altitude  route  structure  using  a DC-10  aircraft  and  a Delco  RNAV  system 
used  inertial  position  recorded  in  the  aircraft  as  actual  aircraft  position. 

For  the  experimental  flight  test  evaluations  at  NAFEC,  the  Extended  Area  In- 
strumentation Radar  (EAIR)  precision  tracking  facility  was  used.  In  the  case 
of  the  University  of  Illinois  cockpit  simulator  tests,  the  actual  track  re- 
ference was  recorded  graphically  using  an  x-y  plotter  as  well  as  digitally  on 
the  Raytheon  mini  computer. 
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Using  the  recorded  parameters  indicated  in  Table  2.1  in  an  effective  man- 
ner allows  interpretation  and  assessment  of  each  of  the  FTE  objectives  stated 
previously.  Table  2.2  illustrates  the  approach  that  is  taken  for  data  utiliza- 
tion throughout  the  remainder  of  this  document. 

FTE  quantification  for  enroute,  terminal  and  approach  modes  will  be  dis- 
cussed based  on  airborne  recording  of  distance  to  waypoint  (DTW),  flight  tech- 
nical error  (FTE)  as  indicated  by  cross  track  deviation  (CTD)  and  detailed 
cockpit  observer  logs.  Primary  analysis  will  center  on  the  achievability  of 
a 1.0  nm  flight  technical  error  for  enroute  and  terminal  applications.  Addi- 
tional issues  covered  in  this  analysis  include  FTE  during  final  approach,  man- 
ual vs.  autopilot  and  FTE  as  a function  of  sensor  inputs  used  by  the  RNAV  system. 

RNAV  maneuvering  procedures  such  as  parallel  offsets,  "Direct  To"  a way- 
point,  and  turn  anticipation  will  be  evaluated  using  actual  track  data  obtained 
from  the  applicable  ground  reference  radar  systems.  Route  width  requirements 
including  turn  overshoot  airspace  will  be  evaluated.  Also,  procedural  and 
aided  turn  anticipation  techniques  will  be  evaluated  as  well  as  turn  perfor- 
mance with  no  turn  anticipation.  Finally,  FTE  during  parallel  offsets,  turns 
and  "Direct  To"  maneuvers  will  be  quantified  for  comparison  with  the  steady 
state  centerline  tracking  FTE  results. 

Waypoint  storage  effects  on  FTE,  workload  and  turn  anticipation  will  be 
evaluated  using  cross  track  deviation,  distance  to  waypoint  and  cockpit  observ- 
er log  data  from  the  GAT-2  simulator  tests. 

An  airspace  utilization  analysis  will  be  performed  based  on  assessment  of 
RNAV  Total  System  Cross  Track  (TSCT)  accuracy.  The  TSCT  analysis  will  also 
provide  the  basis  for  comparing  FTE  to  achievable  total  system  performance  on 
an  empirical  basis.  From  this  empirical  comparison  an  assessment  of  error  com- 
bination techniques  and  error  correlation  will  also  be  derived.  The  results  of 
the  latter  analysis  will  be  used  to  determine  a recommended  analytical  error 
combination  approach  suitable  for  accurate  predictions  of  total  system  cross 
track  error  based  on  measurement  of  FTE  and  the  other  ground  and  airborne  area 
navigation  error  sources.  The  calculation  procedure  developed  would  be  appli- 
cable to  airspace  planning,  RNAV  procedures  development  and  RNAV  system  certifi- 
cation. 

A workload  analysis  will  be  performed  which  quantifies  the  impact  of  pro- 
cedural and  blunder  errors  on  the  nominal  steady  state  FTE  error  budget  values. 
Previous  FTE  investigations  have  performed  similar  analyses  of  procedural  error 
and  blunder  error  tendency  but  have  not  specifically  related  it  to  FTE.  The 
intent  of  the  current  analysis  is  to  provide  workable  estimates  of  procedural 
error  impact  to  be  used  in  evaluating  area  navigation  airborne  equipment  error 
budgets  as  specified  in  AC  90-45A  Appendix  C.4.a.(3).  A similar  approach  to 
quanti fying  the magni tude  of  blunder  errors  will  be  used  to  provide  quantitative 
blunder  tendency  data  for  RNAV  system  designers  as  specified  in  the  same  section 
of  the  appendix.  The  workload  analysis  will  also  include  discussion  of  the  im- 
pact of  3D  navigation  tasks  on  lateral  FTE  and  the  specification  of  typical  RNAV 
update  time  requirements  (RNAV  input  workload). 

The  final  item  of  Table  2.2  is  Equipment  Problems.  This  topic  will  include 
an  analysis  of  2D  and  3D  area  navigation  equipment  anomalies  discovered  during 
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Observer  Logs 


the  testing  of  the  various  levels  of  RNAV  systems.  Topics  such  as  RNAV  compu- 
ter originated  track  angle  discontinuities,  effects  of  GDI  calibration  errors 
and  the  significance  of  glideslope  tracking  errors  will  be  discussed  in  this 
evaluation  based  on  DTW,  GDI  and  altitude  measurements. 

2.4  DATA  REDUGTION 

As  indicated  in  Section  2.3,  the  FTE  data  used  in  this  document  was  acquired 
from  a variety  of  experimental  and  operational  flight  test  programs.  These  pro- 
grams had  a common  minimum  requirement  for  data  recording  which  was  compatible 
with  the  data  analysis  required  to  resolve  the  FTE  issues.  Similarly,  the  data 
processing  required  to  prepare  the  data  for  suitable  analysis  was  based  on  a 
common  functional  approach  to  flight  test  data  reduction.  Although  there  were 
many  different  airborne  data  recording  techniques  and  two  sources  of  ground  ref- 
erence tracking  data  (ARTS  III  and  EAIR).  the  general  process  or  flow  of  data 
from  recording  to  analysis  is  an  important  part  of  this  FTE  analysis.  For  this 
reason,  the  following  section  outlines  the  stepwise  procedure  used  for  data  re- 
duction of  the  operational  flight  test  data.  The  major  functional  steps  of  this 
procedure  were  required  for  both  the  NAFEG  experimental  flight  test  and  the  cock- 
pit simulator  tests. 

The  major  functional  elements  of  the  operational  flight  test  data  reduction 
system  are  as  follows: 

• Airborne  Data  Editing 

• Radar  Data  Editing 

• Airborne/Radar  Data  Merge 

• Track  Analysis  and  Interpolation 

• RNAV  Error  Analysis  (FTE,  TSGT  and  NGT)  and  Statistical  Aggregation 

t RNAV  and  Actual  Track  Route  Summary  Plots 

The  primary  emphasis  of  this  section  is  to  outline  procedures  used  in  each  of 
these  functional  steps.  Reference  to  Figure  2.4  will  aid  in  understanding  the 
data  flow  and  the  interrelationships  of  the  various  data  reduction  elements. 

The  data  reduction  effort  was  directed  toward  the  acquisition  of  tabular, 
graphical  and  statistical  data  consistent  with  maximum  utilization  for  further 
comparison  with  RNAV  data  obtained  from  previous  and  subsequent  programs.  The 
airborne  recorded  data  was  manually  edited,  processed  and  merged  (time  corre- 
lated)with  processed  ARTS  III  data.  The  merge  program  organized  the  data  seg- 
ment and  provided  interpolated  data  for  each  segment  which  terminated  at  the 
bisector  of  the  track  angle  change.  Data  reduction  concluded  with  the  Statis- 
tical Analysis  and  Data  Aggregation  programs.  These  programs  produced  FTE, 

TSGT  and  NGT  statistics  by  flight  for  each  route  segment,  across  all  flights 
on  a given  route  segment,  by  subject  pilot  experience  level,  and  total  aggre- 
gate statistics  for  all  flights,  all  segments  and  all  pilots  on  a given  RNAV 
STAR.  In  addition  to  the  detailed  error  analysis  statistics,  these  programs 
also  provided  graphical  outputs  of  individual  aircraft  radar  tracks,  corres- 
ponding RNAV  indicated  tracks,  summary  statistical  envelope  plots  for  the  mean 
and  two  sigma  errors  on  each  segment  and  summary  histogram  plots  showing  the 
data  frequency  distributions. 
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In  summary,  the  flight  profiles  described  in  Section  2.1  were  used  to  pro- 
vide realistic  RNAV  routes  for  both  flight  test  and  cockpit  simulator  test  ex- 
periments. The  relation  of  the  routes  flown  to  an  operational  environment  pro- 
vides meaningful  data  on  route  segments  of  representative  length  and  over  the 
range  of  turn  angle  magnitudes  and  directions  typical  of  terminal  area  flight. 
The  data  acquired  on  these  routes  was  designed  to  address  specific  RNAV  opera- 
tional problems  and  in  particular  to  resolve  the  question  of  achievable  FTE 
magnitude.  Using  the  recorded  data  indicated  in  Section  2.3  in  an  effective 
manner  allows  interpretation  and  assessment  of  each  of  the  FTE  objectives  stated 
in  Section  1.1. 

The  data  processed  in  the  manner  discussed  in  this  section  was  easily  cate- 
gorized according  to  major  FTE  issues.  All  of  the  flight  test  and  cockpit  simu- 
lator data  analyzed  is  discussed  in  the  following  sections  subdivided  as  follows 

FTE  Quantification  and  Interpretation 

Turn  Performance 

Parallel  Offset  Performance 

Delay  Fan  and  Direct  To  Procedures 

Waypoint  Storage  Effects  on  FTE 

Airspace  Utilization  and  Accuracy 

RNAV  Error  Combination  and  Correlation 

Minimum  RNAV  System  Workload  and  Blunder 
Considerations 


RNAV  Equipment  Considerations 
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DISCUSSION 


The  current  evaluation  of  flight  technical  error  and  its  impact  on  area 
navigation  route  widths  and  procedures  provides  a broad  data  base  upon  which 
preliminary  basic  decisions  can  be  made  regarding  various  FTE  issues.  As  shown 
in  Table  1.3  of  the  Executive  Summary  (Section  1.2),  this  effort  included  the 
analysis  of  the  results  from  491  experimental  flights  (279  in-flight  and  212 
simulator),  using  7 different  combinations  of  area  navigation  systems  and  air- 
craft. The  purpose  of  this  comprehensive  flight  test  and  cockpit  simulator 
program  was  to  acquire  considerable  data,  within  the  normally  encountered 
limitations  of  time  and  funding,  applicable  to  several  basic  areas  of  interest. 
These  areas  of  interest  will  be  referred  to  as  FTE  issues.  This  general  termi- 
nology includes  such  issues  as  airspace  utilization,  which  are  intrinsically 
dependent  upon  FTE. 

The  organizational  format  of  this  discussion  section  is  centered  about 
nine  individual  FTE  issues.  FTE  quantification  is  the  most  basic  of  all  the 
issues,  and  the  results  of  all  pertinent  data  regarding  the  magnitude  of  FTE 
are  presented  in  Section  3.1.  RNAV  maneuver  accuracy  and  the  relationship 
to  FTE  during  turns,  parallel  offsets  and  "Direct  To"  waypoint  procedures  are 
discussed  in  Section  3.2,  3.3  and  3.4  respectively.  The  effects  of  varying 
waypoint  storage  capability  on  FTE  are  discussed  in  Section  3.5.  Sections 
3.6  and  3.7  address  the  RNAV  route  width  (system  accuracy)  and  FTE  combin- 
ations and  correlations  with  other  RNAV  system  errors.  Section  3.8  summarizes 
typical  blunder  and  procedural  error  data  along  with  other  workload  factors 
including  the  effects  of  the  3D  or  VNAV  task  on  lateral  FTE  and  the  time  re- 
quired to  update  the  inputs  to  the  RNAV  computer.  Finally,  Section  3.9  pre- 
sents several  equipment  problems  which  have  a direct  bearing  on  the  magnitude 
of  flight  technical  error. 

3.1  FTE  QUANTIFICATION  AND  INTERPRETATION 

Prior  to  presenting  the  available  data  regarding  flight  technical  error 
magnitudes,  it  is  necessary  to  understand  the  relationship  between  FTE,  RNAV 
system  certification  and  airspace  planning.  Previously,  FTE  was  simply  an- 
other RNAV  error  budget  element  which  was  used  by  manufacturers  to  denonstrate 
compliance  per  Advisory  Circular  90-45  [9],  and  by  airspace  planners  to  pro- 
vide sufficient  route  separation  per  Handbook  7110.18  [7].  Error  budget 
elements  were  assumed  to  be  independent  and  normally  distributed,  and  total 
system  errors  were  cotnputed  in  a root  sum  square  (RSS)  fashion.  That  is,  the 
standard  deviations  obtained  from  the  various  ground  and  airborne  error  sources 
were  combined  algebraically  as  follows: 

a - +0^  +0^  + n 

total  L VOR  DME  RNAV  FTe| 

In  establishing  a system's  performance,  a system  designer  or  airspace  planner 
could  trade  off  reduction  in  the  errors  of  any  of  the  airborne  elements,  pro- 
viding the  specified  total  system  accuracy  was  not  exceeded.  Based  on  the 
issuance  of  Advisory  Circular  90-45A  [1],  the  benefits  of  this  error  combin- 
ation and  trade  off  technique  are  no  longer  available  except  for  a special 
class  of  RNAV  systems. 
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3.1.1  The  Impurtance  of  FTE 


Table  3.1  presents  the  breakdown  of  RNAV  system  classification,  FTE  error 
budget  values  and  accuracy  criteria  by  categories  numbered  (1),  (2)  and  (3). 

The  RNAV  system  classification  is  a direct  quote  from  Appendix  A,  Section  2 
of  AC  90-45A.  According  to  this  document,  category  (1)  systems  must  demon- 
strate that:  "The  total  of  the  error  contributions  of  the  airborne  equipment 

(receivers  plus  area  navigation  - including  desired  track  setting  as  well  as 
waypoint  setting  errors)  when  combined  RSS  with  the  following  specific  error 
contributions  should  not  exceed  the  error  values  shown  in  Table  1,  Appendix 
A."  The  specific  error  contributions  referred  to  are  atl.9®V0R  ground  station 
error  and  a •■0.1  nm  DME  ground  station  error.  Table  1 of  Appendix  A [1]  was 
generated  using  these  ground  station  error  elements  along  with  the  following 
assumptions  for  airborne  error  elements: 


VOR  airborne 

3.0° 

DME  airborne 

3%  or 

RNAV  system 

0.5  nm 

Pilot 

Zero 

0.5  nm 

(including  computer  and  "manual" 
OBS  errors) 


Category  (1)  type  RNAV  systems  can  only  trade  off  airborne  error  elements  from 
the  RNAV  system  with  the  VOR  receiver  error  or  DME  interrogator  error.  The 
magnitude  of  this  limitation  to  the  system  designer  can  be  assessed  by  compar- 
ing Table  1,  Appendix  A [1]  with  Table  2,  Appendix  D [1]  (for  use  by  the  air- 
space planner)  which  includes  the  following  error  elements: 


Ground 


VOR 

1.9° 

DME 

0.1  nm 

Airborne 

VOR 

3.0° 

DME 

3%  or  0.5  nm 

RNAV  System 

0.5  nm 

Pi  lot 

Cross  Track 

2.0  nm 

Along  Track 

Zero 

Figure  3.1  illustrates  the  magnitude  of  the  effect  of  a 2.0  nm  FTE  error  ele- 
ment on  cross  track  RNAV  accuracy  for  enroute  navigation  with  a tangent  point 
distance  of  50  nm.  The  area  between  the  upper  and  lower  limits  is  designated 
"Residual  Error"  and  varies  from  1.0  nm  at  0 nm  along  track  to  0.2  nm  at  an 
along  track  distance  of  130  nm.  The  term  residual  error  was  chosen  to  desig- 
nate the  current  difference  which  exists  between  the  compliance  criteria  for 
category  (1)  type  RNAV  systems  and  the  enroute  waypoint  displacement  area  con- 
sidered for  each  waypoint  when  developing  RNAV  routes  and  procedures.  Thi: 
residual  error  is  no  longer  available  to  the  RNAV  system  designer  as  an  error 
element  trade  off  or  "kitty".  Rather,  the  residual  error  can  be  used  by  the 
FAA  when  evaluating  ground  station  accuracy  requirements  or  reduced  width 
capabilities. 
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CROSS  TRACK  ERROR  LIMITS 


Category  (2)  systems  "must  show  that  the  algorithm  used  will  always  se- 
lect a station  that  will  provide  cross  track/along  track  errors  equal  to  or 
less  than  the  greater  of  the  RNAV  system  errors  of  the  reference  facility  for 
any  RNAV  track  (Table  1)  or  the  errors  shown  in  paragraph  2. a. (3)"  [1].  The 
latter  errors  correspond  to  2.5  nm  enroute,  1.5  nm  terminal  and  0.6  nm  for 
final  approach.  Referring  again  to  Table  3.1  , the  FTE  error  budget  consist- 
ent with  this  requirement  is  either  zero  as  for  category  (1)  systems  or  2.0 
nm  enroute,  1.0  nm  terminal  and  0.5  nm  approach.  However,  the  wording  of  the 
AC  90-45A  requirement  specifies  compliance  with  whichever  error  limit  is 
"greater".  This  essentially  results  in  use  of  the  Table  1 limits  since  the 
error  tolerances  of  Table  1 exceed  the  maximum  enroute  tolerance  of  2.5  nm 
once  an  along  track  distance  of  40  nm  is  exceeded  or  a tangent  point  distance 
greater  than  80  nm  is  used.  For  practical  purposes,  category  (2)  systems 
will  primarily  certify  using  the  Table  1 error  limits  and  zero  FTE. 

Therefore,  the  comments  relevant  to  category  (1)  system  design  and  error 
budgeting  apply  also  to  category  (2)  systems. 

To  provide  further  insight  into  the  differences  in  cross  track  accuracy 
limits  (residual  error)  with  and  without  FTE,  Table  3.2  is  provided.  This 
table  indicates  the  trend  of  the  difference  between  the  accuracy  limits  for 
airspace  planning  for  both’ enroute  and  terminal  area  route  design  and  what 
the  RNAV  system  designer  must  comply  with  for  both  applications.  It  can  be 
seen  that  with  a 2.0  nm  FTE  error  budget  (enroute),  cross  track  accuracy 
differences  of  0.5  nm  to  1.3  nm  exist  within  a 100  nm  circle  of  the  station 
(shaded  area).  Differences  in  cross  track  accuracy  in  excess  of  I.O  nm  occur 
within  25  nm  along  track  for  tangent  point  distances  from  0 to  50  nm.  In  con- 
trast, if  a 1.0  nm  FTE  budget  value  is  used,  the  difference  in  cross  track 
accuracy  utilized  by  the  airspace  planner  and  demonstrated  by  the  system  manu- 
facturer is  reduced  to  0.5  nm  or  less  over  the  major  portion  of  the  terminal 
area  operating  regime  (area  designated  by  diagonal  lines). 

Category  (3)  RNAV  systems  are  handled  somewhat  differently.  These  sys- 
tems must  certify  to  constant  accuracy  limits  of  2.5  nm  enroute,  1.5  nm 
terminal  and  0.6  nm  final  approach.  "The  total  of  the  error  contributions 
of  the  airborne  equipment  (including  update,  aircraft  position  and  computa- 
tional errors)  when  combined  with  appropriate  •'"light  technical  errors"  should 
not  exceed  the  accuracy  limits  listed  "with  95%  confidence  (2-sigma)  over  a 
period  of  time  equal  to  the  update  cycle".  The  FTE  errors  referred  to  are 
listed  in  Tablt,  3.1  for  category  (3).  The  impact  of  this  compliance  criteria 
is  that  the  2-sigma  cross  track  accuracy  assessment  includes  FTE  and  trade 
offs  can  be  made  on  the  system  design  level  with  FTE  and  other  airborne  error 
elements  for  category  (3)  RNAV  systems.  The  basic  error  budget  available  for 
other  airborne  elements  can  be  derived  using  the  equation: 

> 

• a'’  ~| 

total  [_RNAV  FTEj 

Inserting  the  specified  values  for  < , and  - ^,and  solving  the  RNAV  sys- 

tem error  budget  limits  results  in: 
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2a  RNAV  System 
Error  Limits 

1.5  nm 
1.12  nm 
0.33  nm 

To  summarize  what  has  been  discussed,  flight  technical  error  remains  an 
important  RNAV  error  element  for  the  design  and  utilization  of  airspace  as 
designated  in  Appendix  D of  AC  90-45A.  FTE  also  remains  an  explicit  error 
budget  element  within  that  same  document  for  category  (3)  RNAV  system  design 
and  certification  purposes.  FTE  is  not  available  however,  as  a trade  off 
error  element  for  categories  (1)  and  (2)  of  RNAV  systems.  Figure  3.1  was 
presented  to  illustrate  the  effect  of  a 2.0  nm  FTE  error  budget  value  on 
cross  track  RNAV  accuracy  for  enroute  navigation.  This  figure  quantifies  the 
current  discrepancy  which  exists  between  accuracy  compliance  criteria  for 
categories  (1)  and  (2)  of  RNAV  system  (as  defined  in  AC  90-45A)  and  the  accu- 
racy derived  from  combining  the  error  budget  elements  prescribed  for  airspace 
planning  which  include  FTE  (Appendix  D,  AC  90-45A).  The  magnitude  of  this 
discrepancy  was  shown  to  be  as  large  as  1.0  nm  and  the  terminology  "Residual 
Error"  was  used  to  designate  this  difference.  The  magnitude  of  this  Residual 
Error  was  shown  to  be  directly  dependent  upon  the  value  chosen  for  the  FTE 
emor  budget  (Table  3.2  ).  For  example,  an  FTE  error  budget  value  of  2.0  nm 
yields  differences  (between  Appendix  D and  the  Accuracy  Table  1)  in  cross 
track  accuracy  in  excess  of  1.0  nm  within  a 25  nm  radius  of  the  station.  In 
contrast,  a 1.0  nm  FTE  error  budget  value  reduces  the  discrepancy  to  less 
than  0.5  nm  over  the  major  portion  of  the  terminal  area.  The  pre^ence_^f 
' ^r9?_dlff®r?I'C?.5_^®tween  a irspace  pj anni ng  accuracies  and  RNAV  system  com- 
pl iance  accuracjes^ is  conservative  but  leads  to  inefficient  utilization  of  air- 
space. . therefor^,  to  ic.curat_ejy_  determine  the  achievable  cross  track  accuracy 
requirements  and,  the  consistent  route  wioth  reduction  capabilities  in  the  var- 
ious  RNAV  implementation  phases,  it  is  extremely  important  _to_  determine  both 
whether  a 2^0  nm  or  a 1.0  nm  FTE  error  budget  value  ip  appropriate^  and  whjch 
of  these  values  is  real istical ly  attainabje. 


3.1.2  The  Magnitude  of  FTE 


Several  flight  test  programs  were  designed  and  data  collection  was  aimed 
at  addressing  the  issue  of  achievable  flight  technical  error  levels.  These 
flight  test  programs  utilized  both  the  operational  enroute,  terminal  and 
approach  flight  regimes  of  today's  National  Airspace  System  (NAS)  and  the  ex- 
perimental environment  provided  by  the  National  Aviation  Facilities  Experimental 
Center  (NAFEC)  which  was  necessary  for  the  more  controlled  evaluation  of  spe- 
cific FTE  issues.  Existing  RNAV  routes  and  published  RNAV  charts  and  proce- 
dures were  used  primarily  in  the  actual  NAS  environment  while  experimental 
route  designs  and  RNAV  concepts  and  procedures  recommended  by  the  Task  Force 
Report  [2]  were  used  in  the  NAFEC  experiments.  The  area  navigation  systems 
tested  included  a sampling  from  all  three  categories  listed  in  AC  90-45A. 
Specifically,  the  King  KN  Butler  VAC/ADD  and  Delco  R130A  systems  are 
category  (IJ.  The  Collins  ANS-70A  is  a category  (2)  and  the  Litton  LTN104  is 
a category  (3)  RNAV  system.  The  range  of  aircraft  type  used  for  these  tests 
varied  from  the  light  twin  class  represented  by  the  Aero  Coimiander  500  to  the 
wide  body  "heavy"  jet  transport  class  represented  by  the  Douglas  DC-10. 
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Although  each  experiment  contained  a different  mixture  of  subject  pilots, 
each  subject  in  all  mixtures  held  at  least  a comnercial  pilot  certificate 
with  an  instrument  rating.  The  entire  set  of  subjects  included  airline  pilots, 
FAA  test  pilots  and  general  aviation  pilots. 

Enroute 


The  overall  results  from  this  extensive  flight  test  evaluation  of  flight 
technical  error  are  presented  in  Table  3.3  . 

The  data  presented  in  this  table  was  derived  from  steady  state,  center- 
line  tracking  flight  test  results.  "Steady  state"  indicates  that  transient 
course  deviation  indicator  deflections  (the  measure  of  FTE)  due  to  turns, 

OBS  changes,  waypoint  (p,  0)  input  and  blunder  errors  have  been  edited  from 
the  FTE  statistics  for  each  flight  prior  to  aggregation  of  cross  flight 
statistics  for  each  test  program.  "Centerline  tracking"  indicates  that  none 
of  the  FTE  values  shown  in  Table  3.3  were  derived  from  desired  tracks  that 
were  parallel  offsets  of  the  parent  route.  Turn  data  will  be  treated  sepa- 
rately in  Section  3.2  and  parallel  offsets  will  be  treated  in  Section  3.3. 

The  enroute  results  show  that  a two-sigma  FJE  valjj^  of  ±0.72  nm  was 
attainable  for  enroute  operations.  This  value  was  obtained  from  an  aggre- 
gation of  87  flights  on  a wide  range  of  ai rcraft/RNAV  system  combinations. 

The  confidence  level  that  the  two-sigma  FTE  of  all  systems  on  all  types  of 
aircraft  will  be  acceptably  close  to  this  estimate  based  on  87  samples  may 
be  calculated  using  the  standard  error  of  the  standard  deviation.  This 
standard  error  is  defined  as  a/',  2n  for  a large  number  of  samples,  n. 

For  a 95%  confidence  level,  two  'standard  errors  normally  define  the  confi- 
dence interval  for  the  standard  deviation,  that  is,  for  large  samples  one  may 
be  95%  sure  that  the  actual  population  standard  deviation  will  not  differ 
from  the  large  sample  standard  deviation  by  more  than  ±2  (a/\  2n  ) or  two 
standard  errors.  The  two  standard  deviation  or  two-sigma  confidence  inter- 
val then  simply  becomes  t4  (a/ \ 2n  ) . Therefore,  for  these  experiments, 
we  may  be  95%  sure  tnat  the  FTE  experienced  in  tTi'e  enroUte  NAS  ehvTronmervt' 
will  lie  within  3.61  to  0.83  nm.  These  results  show  conclusively  that  a re- 
duction in  the  enroute  FTE  error  budget  from  2.0  nm  to  1.0  nm  is  attainable 
with  95%  confidence  level.  This  value  for  enroute  FTE  was  proposed  by  the 
Task  Force  and  certainly  appears  reasonable  based  on  these  specific  test 
results  which  were  designed  to  resolve  this  issue. 

The  results  summarized  in  Table  3.3  may  be  analyzed  by  several  methods. 
The  table  indicates  a subdivision  of  the  results  by  airspace  region,  namely, 
enroute,  terminal  and  approach.  However,  before  examining  the  terminal  and 
approach  airspace  it  is  interesting  to  analyze  the  enroute  data  for  differ- 
ences in  FTE  with  RNAV  system  complexity  and  cost.  Basically,  the  Delco  and 
Litton  systems  are  airline  quality  systems  and  the  aircraft  types  used  in 
these  tests  are  certainly  represcntati ve  of  airline  operations.  An  aggre- 
gation of  the  results  from  these  experiments  indicates  that  for  a total  of 
37  flights  the  two-sigma  FTE  was  ±0.5  nm  with  a 95%  confidence  interval  of 
0.38  to  0.62  nm.  T:.at  is,  based  on  these  37  flights,  the  total  population 
of  all  airl  ine  qual  i ty  area  navigation  eq^uipped  aircraft  cam  be  expected  to 
fall  within  the  0.38  - 0.62  nm  FTF  interval  with  a 95^  confjdence  level. 

This  can  be  interpreted  as  providing  a 0.4  nm  buffer  or  a 40'^  safety  factor 
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TABLE  3.3  FLIGHT  TECHNICAL  ERROR  EVALUATION  SUMMARY 

(Zero  Mean  Assumed,  VOR/DME  Except  as  Noted) 

I 


Data  Source 

FI  ight 
Phase 

Number 

of 

FI ights 

Two-Sigma 
FTE  - nm 

Comments 

DC-IO/DELCO*  Manual 

Enroute 

5 

.73 

Enroute  Requirements 

- Autopilot 

Enroute 

9 

.29 

Task  Force  Report: 

727/LITTON  (NAFEC) 

Inertial  Manual  Updating 

Enroute 

13 

.22 

Phase  1 - 2.0  nm 

Inertial  Automatic 
Updati ng 

Enroute 

10 

.72 

Phase  2 - 1.0  nm 
Phase  3 - 1.0  nm 

G-1  BUTLER  (NAFEC) 

Enroute 

45 

.82 

A. C. 500/KING  (NAFEC) 

Enroute 

5 

1.05 

AC  90-45A  - 2.0  nm 

All  Systems  Combined 

Enroute 

B 

.72 

DC-IO/DELCO-  Autopilot  (ORD) 

Termi nal 

n 

.23 

Terminal  Area 

- Autopilot  (DEN) 

Termi nal 

.42 

Requi rements 

727/LITT0N*(NAFEC) 

Inertial  Manual  Updating 

Termi nal 

13 

.21 

Task  Force  Report: 

Inertial  Automatic 
Updati ng 

Terminal 

10 

.75 

1.0  nm  All  Phases 

G-1/C0LLINS*(NAFEC) 
DME/DME  Manual 

Termi nal 

14 

.25 

AC  90-45A  - 1.0  nm 

DME/DME  Autopilot 

Terminal 

14 

.18 

VOR/DME  Manual 

Termi nal 

7 

.25 

VOR/DME  Autopilot 

Terminal 

8 

.18 

VDR/DME/ VOR/DME  Autopilot 

Terminal 

7 

.17 

A. C. 500/KING  (DEN  & MIA) 

Terminal 

37 

1.05 

G-l/BUTLER  (NAFEC) 

Terminal 

45 

.68 

A. C. 500/KING  (NAFEC) 

Terminal 

30 

1.54** 

BEECH  Twin  6c -,/SUTLER  (CMI) 

Terminal 

62 

.95 

All  Systems  Combined 

Terminal 

261 

.88 

G-1/C0LLINS*(DME/DME) 

Approach 

28 

.21 

Task  Force/AC  90-45A 
0.5  nm  All  Phases 

A.C.500/KIN6 

Approach 

33 

.49 

+0.25  nm/dot 

BEECH  Twin  Bon/BUTLER 

Approach 

32 

.56 

il.O  nm/dot 

BEECH  Twin  Bon/BUTLER 

Approach 

16 

.20 

±0.25  nm/dot 

All  Systems  Combined 

Approach 

109 

.43 

* Flight  Director  Equipped. 

**  Obvious  Outlier  - data  will  be  analyzed  with  and  without  this  particular  data 

set.  See  Table  3.T. 


when  the  1,0  nni  enroute  FTE  error  budget  value  is  applied  to  these  system  types. 

In  contrast,  aggregation  of  the  data  from  the  two  systems  representative 
of  general  aviation,  that  is,  the  Butler  and  King,  shows  that  the  two-sigma 
FTE  would  increase  to  ±0.84  nm.  The  reasons  for  this  increase  are  many  and 
generally  well  understood.  In  particular,  the  general  aviation  tests  were 
conducted  as  a single  pilot  operation  while  the  Delco  and  Litton  tests  con- 
sisted of  multicrew  operations  which  distributed  the  communication,  navi- 
gation and  flying  workload.  Also,  the  general  aviation  data  did  not  include 
any  autopilot  FTE  results  while  the  airline  quality  tests  consisted  of  nine 
autopilot  and  28  manual  flights  for  the  total  of  37  flights.  (The  compari- 
son of  manual  vs.  autopilot  will  be  done  subsequently  in  Section  3.1.3.) 

Finally,  the  airline  quality  sensors  and  receivers  are  known  to  be  more 
accurate  which  results  in  a generally  more  stable  course  deviation  indicator 
and  therefore  less  needle  chasing  and  the  end  result  being  lower  measured 
FTE.  Although  the  0.84  nm  two-sigma  FTE  is  still  within  the  desired  ±1.0  nm 
error  budget  value,  it  is  larger  than  the  airline  quality  FTE  by  a factor  of 
1.68.  Also,  when  the  95%  confidence  interval  is  examined,  it  is  found  that 
the  entire  general  aviation  RNAV  population  can  be  expected  to  fall  within 
0.68  nm  to  1.00  nm  FTE.  The  general  conclusions  to  be  drawn  from  these  en- 
route results  are  that  both  airline  quality  and  general  aviation  type  RNAV  sys- 
tems can  be  flown  with  an  FTE  of  1.0  nm  or  less  in  the  enroute  airspace  and  that, 
as  would  be  expected,  the  more  costly  and  sophisticated  airline  quality  systems 
with  mul ti crewmember  operations  demonstrate  significantly  lower  flight  techni- 
cal error. 

•» 

Terminal 


The  overall  results  for  terminal  area  operations  demonstrated  that  a 
two-sigma  FTE  value  of  ±0.88  nm  was  achievable.  This  value  (see  Table  3. 3 ) 
was  obtained  from  an  aggregation  of  261  flights  using  seven  different  air- 
craft/RNAV  system  combinations.  The  95%  confidence  interval  shows  that  the 
entire  population  of  RNAV  system/aircraft  combinations  can  be  expected  to 
fall  within  0.80  to  0.96  nm  FTE  limits  for  terminal  area  maneuvering.  This 
level  of  FTE  is  also  less  than  the  desired  ±1.0  nm  FTE  error  budget  value 
for  tenninal  area  operations.  The  0.80  to  0.96  nm  range  of  confidence  is 
slightly  higher  than  the  enroute  confidence  interval  of  0.61  to  0.83  nm, 
but  close  enough  to  demonstrate  some  overlap.  The  slight  difference  in 
upper  confidence  level  limits  (.13  nm)  would  certainly  be  attributed  to 
the  higher  workload  environment  typical  of  terminal  area  operations  in 
general.  This  environment  combined  with  the  fact  that  87  flights  were  air- 
line quality  systems  while  174  flights  were  general  aviation,  single  pilot 
operations  adequately  accounts  for  such  a small  difference  (less  than  0.25  nm 
can  be  considered  acceptably  small  for  all  but  final  approach  operations). 

If  the  terminal  area  results  areexamined  further  to  quantify  the  dif- 
ference in  FTE  for  these  two  system  types,  the  Delco,  Litton  and  Collins 
data  can  be  combined  for  airline  type  systems.  FTE  for  these  three  systems 
was  ±0.34  nm  (two-sigma)  in  87  terminal  area  flights.  This  compares  to  the 
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■0.50  nm  obtained  enroute  for  airline  systems.  The  terminal  area  aggregation 
for  general  aviation  systems  combines  results  from  174  flights  of  the  King 
and  Butler  systems  and  demonstrates  a *1.00  nm  two-sigma  FTE.  Once  again  as 
in  the  enroute  analysis,  airline  system  FTE  is  significantly  less  than  general 
aviation.  In  this  case,  airline  FTE  is  only  34%  of  the  value  measured  for  the 
general  aviation  systems.  The  general  conclusion  to  be  drawn  from  these  ter- 
minal area  tests  is  that  all  systems  tested  were  acceptably  within  the  desired 
•1.0  nm  FTE  budget  value. 

Approach 

The  aggregated  results  for  final  approach  airspace  showed  a significantly 
reduced  FTE  whether  all  systems  were  combined  and  compared  to  the  other  airspace 
regions  or  whether  airline  systems  were  compared  to  airline  and  general  aviation 
to  general  aviation.  As  shown  in  Table  3.3,  a final  approach  two-sigma  FTE  of 
•0.43  nm  was  obtained  from  a total  of  109  RNAV  approaches  with  three  different 
ai rcraft/RNAV  combinations.  The  confidence  interval  for  these  109  flights  was 
0.37nm  to  0.49  nm  which  indicates  a 95T  conf i'dence  _t_h at  all  systems  will  be 
within  the  proposed  0.5  nm  FTE  error  budget  value  for  final  approach  airspace. 

The  airline  quality  systems  were  represented  by  the  Collins  data  which  showed 
a two-sigma  FTE  of  *0.21  nm.  The  general  aviation  data  consisted  of  King  and 
Butler  tests,  the  latter  system  being  flown  with  two  different  CDI  sensitiv- 
ities. Aggregated  totally,  these  results  showed  a i.48  nm  two-sigma  FTE  was 
achievable  for  general  aviation  type  systems.  As  would  be  predicted  the  Butler 
data  with  poorer  resolution  ('1.0  nm/dot)  demonstrated  significantly  worse  FTE 
than  the  more  sensitive  0.25  nm/dot  tests  on  the  same  system.  FTE  was  reduced 
from  0.56  nm  to  0.20  nm  or  by  a factor  of  2.8  times. 

FTE  Differences  Due  to_  RNAX  System  Type 

The  primary  impact  of  RNAV  system  capability  on  FTE  is  due  to  the  varying 
pilot  data  handling  and  data  input  workload  involved  due  to  variations  in  system 
automation.  In  general,  the  more  sophisticated  and  costly  airline  quality  systems 
require  less  in-flight  programming  and  procedural  workload  due  to  provisions  for 
storage  of  a large  number  of  waypoints,  automatic  turn  anticipation  and  parallel 
offset  capability.  The  penalty  paid  for  this  automation  is  one  of  increased 
system  operation  complexity  and  more  difficult  pre-flight  programmiiing.  However, 
once  the  proper  procedures  are  adequately  learned  through  exposure  and  training, 
FTE  on  these  systems  would  be  expected  to  be  lower  than  comparable  general 
aviation  data. 

In  contrast,  the  general  aviation  (G.A.)  systems  tested  provided  only  one 
and  two  waypoint  storage  capability,  no  turn  anticipation  and  no  input  for  par- 
allel offset  tracks.  The  latter  two  items  were  left  to  the  procedural  expertise 
of  each  individual  subject  pilot.  Finally,  the  general  aviation  data  was  acquired 
in  a representative  single  pilot  operation  as  opposed  to  the  multicrew  situation 
which  typified  the  airline  quality  flight  tests.  For  all  of  these  reasons,  FTE 
of  the  general  aviation  systems  is  expected  to  be  higher  than  airline  quality 
data. 


Table  3.4  categorizes  the  FTE  data  obtained  by  system  type  and  the 
aggregate  data  for  all  systems.  It  should  immediately  be  noted  that  for  all 
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Table  3. 4 


FTE  LIMITS  FOR  ALL  SYSTEMS  TESTED 
IN  THREE  AIRSPACE  REGIONS 


SYSTEM  TYPE 

Airspace 

Airl ine 

G.  A. 

G.A.  w/o 
Outl ier 

All 

Systems 

All  Systems 
w/o  Outl ier 

Enroute 

Number  of  FI ights-n 
Two-Sigma  FTE  - nm 
95%  Confidence 
Interval -nm 

37 

.50 

.38  - .62 

50 

.84 

.68  - 1.00 

45 

.82 

.65  - .99 

87 

.11 

.61  - .83 

82 

.69 

.58  - .80 

Termi nal 

Number  of  Flights-n 
Two-Sigma  FTE  - nm 
95%  Confidence 
Interval -nm 

87 

.34 

.29  - .39 

174 

1.00 

.89  - i.n 

144 

.90 

.80  - 1.00 

261 

.88 

.80  - .96 

231 

.74 

.67  - .81 

Approach 

Number  of  Flights-n 

28 

81 

Not 

Appl i cabl e 

109 

Not 

Appl icable 

Two-Sigma  FTE  - nm 

.21 

.48 

Not 

Appl icabl e 

.43 

Not 

Applicable 

95%  Confidence 
Interval -nm 

.15  - .27 

.40  - .56 

Not 

Appl icable 

.37  - .49 

Not 

Appl icable 

/Note/  For  large  sample  sizes  we  may  be  95%  sure  that  the  FTE  lies  within 
the  range  of  +2(2a/Y  2n  ) or  twice  the  standard  error  of  two 
standard  deviations . 

Outlier  - A.C.  500/King  (NAFEC)  Termi nal ■ Area  FTE  of  1.54  nm  for  30  flights 
was  deleted. 

RNAV  systems  tested  the  enroute  and  terminal  FTE  data  was  within  the  ±1.0  nm 
tolerance  based  on  a two-sigma  95%  confidence  interval  analysis.  The 
approach  FTE  data  for  all  systaiis  was  also  within  the  desired  *0.5  nm  error 
tol erance. 

The  second  conclusion  to  be  drawn  from  Table  3.4  is  that  airline  quality 
FTE  data  was  consistently  less  than  the  general  aviation  data  by  a signifi- 
cant amount.  As  previously  stated,  the  percent  differences  between  airline 
and  general  aviation  data  were:  enroute  - 40%,  terminal  - 66  , and  approach  - 


56%.  This  data  confirms  the  expected  trends  indicated  in  the  introduction 
of  this  subsection.  A more  detailed  analysis  of  the  enroute  and  terminal 
data  by  system  type  provides  further  substantiation  of  the  impact  of  higher 
workload  on  FTE.  Specifically,  the  airline  system  data  showed  a decrease  in 
FTE  from  0.50  nm  enroute  to  0.34  nm  terminal  (-32  ) while  the  general  avi- 
ation data  displayed  the  opposite  trend.  G.A.  FTE  data  increased  from 
0.84  nm  enroute  to  1.00  nm  in  the  terminal  area  (+19  ).  This  is  again  a re- 
flection of  the  increased  workload  imposed  on  the  G.A.  user  by  the  one  or 
two  waypoint  storage  limitation  in  the  terminal  environment  where  waypoints 
are  more  closely  spaced  and  both  the  aircraft  system  managenent  and  ATC 
communication  workloads  also  increase. 

However,  as  pointed  out  in  Table  3.3  , the  G.A.  terminal  data  aggre- 
gation did  contain  30  flights  of  the  King  system  which  appeared  to  be  an 
outlier  data  set.  This  data  showed  a +1.54  nm  FTE  as  opposed  to  the  re- 
n._,ning  terminal  data  which  varied  from  ±0.17  nm  to  a maximum  of  ±1.05  nm. 

To  firmly  establish  whether  or  not  G.A.  FTE  should  be  worse  than  airline 
FTE,  the  data  was  also  aggregated  omitting  these  30  flights  on  the  King  system. 
The  results  indicated  that  FTE  still  increased  in  general  aviation  terminal  area 
operations,  but  only  by  a factor  of  10%  (*0.82  nm  enroute  to  *0.90  nm  terminal). 

An  additional  fact  resulted  from  this  aggregation  of  G.A.  data  without 
the  outlier.  That  is,  both  enroute  and  terminal,  the  ±1.0  nm  limit  was  not 
exceeded  by  the  general  aviation  two-sigma  value  whereas  previously  including 
the  outlier  produced  a two-sigma  FTE  of  1.11  nm  for  terminal  G.A.  operations. 

Finally,  the  fact  that  enroute  FTE  of  less  than  ±1.0  nm  can  be  achieved 
is  firmly  established  by  examination  of  both  the  two-sigma  level  and  the  95% 
confidence  intervals.  Airline  data  demonstrated  ±0.5  nm  with  a 95%  confi- 
dence interval  of  0.38  to  0.62  nm.  General  aviation  data  demonstrated  ±0.82  nm 
with  a confidence  interval  of  0.65  to  0.99  nm.  Similarly,  terminal  operations 
showed  airline  data  well  within  the  ±1.0  nm  tolerance  and  general  aviation  data 
with  a two-sigma  FTE  of  0.90  nm  and  a confidence  interval  of  0.80  to  1.00  nm 
which  was  totally  acceptable. 

Addi tional  Analysis 

In  addition  to  the  gross  verification  of  the  attainability  of  a 1.0  nm 
FTE  in  enroute  and  terminal  area  operations  and  0.5  nm  in  final  approach 
operations.  Table  3.3  provides  pertinent  data  regarding  several  other  impor- 
tant issues.  For  example,  comparing  the  three  levels  of  RNAV  systems  tested 
in  the  Denver  terminal  area  (the  King  KN  74,  the  Delco  and  the  Collins  ANS-70A), 
it  can  be  seen  that  the  FTE  varies  from  1.05  to  0.42  and  0.25.nm  respectively. 
However,  the  Delco  data  available  was  limited  to  two  flights  on  a single  RNAV 
STAR  designated  the  FRAIL  ONE  RNAV  ARRIVAL  which  was  essentially  a straight- 
in  approach  to  runway  26L  at  DENVER.  To  obtain  further  insight  into  this 
comparison.  Table  3.5  presents  the  King  data  from  the  same  STAR  for  direct 
comparison  with  the  two  Delco  flights.  This  comparison  verifies  on  a single 
route  that  the  FTE  difference  observed  for  airline  RNAV  systems  is  still  32, 
as  shown  in  Table  3.4  for  all  systems  and  routes  tested.  Unfortunately, 

Collins  flights  over  this  same  route  had  airborne  data  acquisition  problems 
so  the  direct  comparison  of  the  G-l/Collins  data  on  the  TRAIL  arrival  is  not 
avai lable. 
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Table  3.5  TRAIL  ONL  Arrival  ITE  Comparison  I 


Bias  *2t 

No.  of 

FI i ghts 

KN  74 

0.05R  *0.62  nm 

4 

DELCO 

0. 14L  *0.42  nm 

2 

A second  observation  from  the  data  shown  in  Table  3.3  is  that  the  air- 
line operational  RNAV  flight  test  in  the  Chicago  teniiinal  area  (12  flights) 
substantiated  the  level  of  FTE  measured  in  the  experimental  investigations 
at  NAFEC.  Both  the  Delco  and  the  Collins  data  demonstrated  that  autopilot 
FTE  of  less  than  0.25  nm  was  achievable.  The  fact  that  this  FTE  data  was 
taken  using  two  different  aircraft,  in  two  completely  different  airspace 
environments  and  two  airline  quality  RNAV  systems  enhances  the  reliability 
and  significance  of  the  statistical  aggregations. 

Before  proceeding  to  a comparison  of  manual  vs  autopilot  FTE,  it  is 
interesting  and  important  to  compare  the  mean  or  bias  errors  for  all  the  RNAV 
flight  test  data.  Table  3.3  is  presented  assuming  a zero  mean  error  for  all 
data  sources.  This  was  done  to  permit  a direct  comparison  to  the  requirements 
specified  in  the  Task  Force  Report  and  AC  90-45A  since  these  requirements 
assumed  a zero  mean.  Table  3.6  presents  the  actual  bias  errors  which  were 
measured.  Each  of  the  indicated  biases  is  associated  with  a particular  flight 
test  program  and  the  number  of  flights  is  identical  to  that  indicated  in  Table 

3.3  for  the  same  flight  test  program.  These  bias  errors  are  extremely  small 
and  within  the  measurability  tolerance  of  each  of  the  test  programs.  Flowever, 
a literal  interpretation  of  the  meaning  of  these  small  bias  errors  is  as 
follows.  Table  3.6  indicates  a slight  tendency  of  pilots  to  fly  to  the  right 
of  desired  course.  Bias  errors  in  nautical  miles  ranged  from  0.14L  to  0.27R 
for  all  the  FTE  data.  Enroute,  bias  errors  in  nautical  miles  ranged  from 
O.IOL  to  0.27R  for  all  the  FTE  data  taken.  When  all  the  mean  errors  were 
aggregated  a bias  to  the  right  of  desired  course  of  0.07  nautical  miles  in 
the  terminal  area,  and  0.04  nautical  miles  enroute,  resulted.  This  should  be 
interpreted  to  mean  that  the  variability  with  which  pilots  fly  RNAV  based  on 
two-sigma  (95»  probability)  is  *0.88  nm  in  terminal  area  operations  and  *0.72 
nn,  enroute.  However,  there  is  a slight  skewness  in  the  data  which  is  reflected 
in  the  0.07R  and  0.04R  biases.  For  terminal  airspace  planning  purposes,  a 
literal  interpretation  of  this  data  would  be  that  FTE  error  budget  values 
should  include  a bias  plus  two-sigma  of  0.81  nm  and  a bias  minus  two-sigma  of 
0.95  nm.  However,  this  same  data  shows  that  the  0.07R  track  bias  does  not 
significantly  affect  the  general  conclusion  that  a *1.0  nm  FTE  budget  value 

is  totally  adequate  in  the  terminal  area.  Similarly,  enroute,  the  bias  plus 
two-sigma  would  be  0.68  nm  and  the  bias  minus  two-sigma  would  be  0.76nm,both 
of  which  are  well  below  the  desired  *1.0  nm  enroute  FTE  budget  value. 

3.1.3  Manual  and  Autopilot  FTE  for  Airl i ne_  Type_  RNAV  systems 

The  next  FTE  data  of  interest  is  the  relative  performance  of  manual  vs 
autopilot  navigation  accuracy  as  measured  by  and  displayed  to  the  pilot  by 
the  cross  track  deviation  indicator.  The  primary  data  available  regarding 
a direct  comparison  of  autopilot  vs  manual  FTE  is  from  the  Collins  ANS-70A 
evaluation  performed  at  NAFEC.  This  data  will  be  discussed  first  due  to 
the  completeness. 
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Table  3.6 


MEAN  VALUES  FOR  FTE  FLIOHT  TEST  F.ESUl.TS 


Data  Source 

FI  ight 
Phase 

Number' 

of 

n ights 

Mean  j 
FTE-nm  ! 

DC-IO/DELCO-  Manual 

Enroute 

5 

.09R 

- Autopilot 
727/LITTON  (riAFEC) 

Enroute 

9 

.03L 

Inertial  Manual  Updating 
Inertial  Automatic 

Enroute 

13 

■ lOL 

Updating 

Enroute 

10 

.07R  1 

G-I  BUTLER  (NAFEC) 

Enroute 

45 

.06R  1 

A. C. 500/KING  (NAFEC) 

Enroute 

5 

1 .27R  j 

All  Systems  Combined 

Enroute 

87 

1 

,04  k I 

DC-IO/DELCO-  Autopilot  (ORD) 

Terminal 

12 

.05L  i 

- Autopilot  (DEN) 
727/LITTON  (NAFEC) 

Termi nal 

2 

.14L  ; 

Inertial  Manual  Updating 
Inertial  Automatic 

Terminal 

13 

■ 06L  j 

Updati ng 

G-l/COLLINS  (NAFEC) 

Termi nal 

10 

.14R  i 

DME/DME  Manual 

Termi nal 

14 

.05R  i 

DME/DME  Autopilot 

Terminal 

14 

■ OIR  1 

VOR/DME  Manual 

Terminal 

7 

. U5K  i 

VOR/DME  Autopilot 

Tetmii  nal 

a 

■ 02R  i 

VOR/DME/VOR/DME  Autopilot 

Terminal 

7 

.OIR 

A. C. 500/KING  (DEN  & MIA) 

Terminal 

37 

.13R 

G-l/BUTLER  (NAFEC) 

Terminal 

45 

.OIL 

A. C. 500/KING  (NAFEC) 

Termi nal 

30 

.27R 

BEECH  Twin  Bon/BUTLER  (CMI) 

Terminal 

62 

. 07R 

All  Systems  Combined 

Terminal 

261 

.07R 

G-l/COLLINS  (DME/DME) 

Approach 

28 

.OOIR 

A. C. 500/KING 

Approach 

33 

. 12L 

BEECH  Twin  Bon/BUTLER 

Approach 

32 

. 06L 

BEECH  Twin  Bon/BUTLER 

Approach 

16 

. 04L 

All  Systems  Combined 

Approach 

^ 

109 

1 

.06L 

_ 
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Table  3.7  presents  the  entire  set  of  FTE  data  taken  during  a 28  flight 
experiment  on  the  Collins  system  at  NAFEC.  The  manual  and  autopilot  aggre- 
gate statistics  for  each  route  segment  were  derived  by  using  the  data  from 
fourteen  individual  flights  for  each  mode,  manual  and  autopilot.  The  route 
flown  was  illustrated  in  Figure  2.3  of  Section  2.0  and  is  designated  as  6-2. 

The  route  segments  can  be  identified  from  this  figure.  The  bias  errors  indicated 
in  Table  3.7  are  once  again  not  reliably  different  from  zero.  The  two-sigma 
errors  of  -0.25  nm  manual  and  ^0.^8  nm  autopilot  are  both  statistically  reliable 
numbers  and  are  both  substantially  less  than  the  -1.0  nm  FTE  error  budget  value 
allowed  for  terminal  area  operations.  The  maximum  errors  measured  were  *0.37  nm 
in  the  manual  mode  and  -0.21  nm  in  the  autopilot  mode.  This  high  degree  of  accu- 
racy is  attributable  to  the  DME/DME  navigation  mode  as  well  as  the  quality  of  the 
airborne  DME  interrogators  and  the  Collins  ANS-70A  filtering  technique. 


Table  3.8  was  created  to  summarize  the  operational  enroute  data  acquired 
during  normal  operations  of  a DC-10  aircraft  using  the  Delco  RNAV  system. 

This  data  verifies  that,  based  on  a limited  sample  of  b manual  flights  and  9 
autopilot  flights,  the  1.0  nm  enroute  FTE  was  attainable  in  both  modes  of  op- 
eration. This  result  compares  favorably  and  tends  to  substantiate  the  exper- 
imental test  data  on  the  Collins  system  at  NAFEC.  Care  should  be  taken,  how- 
ever, in  interpreting  the  two-sigma,  enroute,  manual  FTE  summary  statistics. 

The  two-sigma  calculation  has  very  little  practical  application  when  based  on 
5 data  flights.  These  calculations  were  only  performed  to  provide  qualitative 
trends  for  enroute  FTE,  to  indicate  whether  FTE  was  near  the  desired  1.0  nm 
error  budget  value  or  greater  than  the  2.0  nm  error  budget  value  and  to  qual- 
itatively compare  the  Collins  and  Delco  data.  However,  in  the  case  of  the  auto- 
pilot data,  9 flights  having  much  smaller  variability  range  from  0.18  to  0.39 
nm  two-sigma  may  not  be  totally  unrepresentative.  This  is  true  because  the  nine 
flights  used  included  significantly  long  and  level  enroute  segments.  The  mag- 
nitude of  the  aggregate  of  the  two-sigma  statistics  from  the  nine  flights  (-0.26 
nm)  is  also  substantiated  by  the  Collins  autopilot  data. 

The  Delco  area  navigation  system  was  also  tested  in  the  Chicago  terminal 
area  in  the  autopilot  mode.  As  shown  on  Table  3.3,  the  results  from  the  RNAV 
STARS  indicated  that  autopilot  FTE  in  the  terminal  area  on  the  order  of  zO.23  nm 
was  achievable.  This  data  set  adequately  closes  the  loop  on  the  autopi 1 ot/termi - 
nal  area  data  from  the  Collins  tests  in  the  more  sterile  terminal  environment  of 
NAFEC  which  demonstrated  FTE  of  ±0.18  nm.  The  detailed  flight  summary  statistics 
for  all  of  the  enroute  and  terminal  area  Delco  data  are  presented  in  Appendix  B. 

Conclusions  to  be  drawn  from  the  preceding  analysis  may  be  summarized 
as  follows: 

1)  Both  manual  and  autopilot  FTE  data  in  the  terminal  area  are 
significantly  less  than  1.0  nm  based  on  a two-sigma,  95 
confidence  level  analysis. 
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TABLE  3.7 


MANUAL  VS.  AUTOPILOT  FLIGHT  TECHNICAL  ERROR  - NAFEC  RESULTS 
(DME/OME  Mode;  Autoselect  Reference  Facility) 


ROUTE 

SEGMENT 

Manual 

FTE 

(14  Flights) 

P 



Autopi lot 
FTE 

(14  Flights) 

MEAN 

±2a 

MEAN 

±2a 

ROMEO  - SIERRA 

0.07R 

0.20 

0.03R 

0.13 

SIERRA  - TANGO 

0.05R 

0.19 

O.OOL 

0.17 

TANGO  - WHISKEY 

0.05R 

0.10 

O.OIR 

0.14 

WHISKEY  - XRAY 

0.08R 

0.20 

0.03R 

0.21 

XRAY  - YANKEE 

0.06R 

0.33 

0.03R 

0.19 

YANKEE  - VICTOR 

O.OOL 

0.26 

0.05L 

0.16 

VICTOR  - GOLF 

O.OIR 

0.37 

0.04L 

0.15 

GOLF  - BALTIC 

O.OIR 

0.22 

O.OIL 

0.10 

GOLF  - HOTEL 

O.OOL 

0.19 

0.05L 

0.11 

HOTEL  - INDIA 

0.08R 

0.17 

0.04R 

0.12 

INDIA  - JULIET  (MAP) 

0.08R 

0.14 

0.02R 

0.07 

BALTIC  - CC 

O.OIR 

0.23 

0.06L 

0.17 

CC  - DD  ( MAP) 

0.04L 

0.30 

0.09L 

0.10 

All  Segments  Combined 

0.05R 

0.25 

O.OIL 

0.18 

TABLE  3.8  ENROUTE  MANUAL  VS.  AUTOPILOT  FTE  - OPERATIONAL  RESULTS 
(VOR/DME  Mode;  Charted  Reference  Facility) 


Departure  - 
Destination 

Manual 

FTE(nm) 

Autopilot 
FTE  (nm) 

SFO  - DEN  (Ascent) 

.OIL  ±1.06 

SFO  - DEN  (Descent) 

. tV^R  ± . 70 

- 

ORD  - DEN  (Level) 

’.02L  ± .85 

.04L  ±.29 

ORD  - DEN 

- 

.06L  ±.31 

ORD  - DEN 

- 

.004L  ±.24 

ORD  - DEN 

- 

.03L  ±.18 

LAX  - ORD 

.02R  ± .26 

- 

LAX  - ORD 

.05R  ± .27 

- 

LAX  - ORD 

.005R  ± .22 

- 

DEN  - ORD 

- 

.02R  ±.28 

DEN  - ORD 

- 

.03L  '.30 

DEN  - ORD 

- 

.02L  • .31 

DEN  - ORD 

- 

.08L  ±.39 

DEN  - ORD 

.04L  ±.32 

SFO  - DEN  Combined 

.26R  ± .96 

- 

DEN  - ORD  Combined 

- 

.03L  ±.30 

ORD  - DEN  Combined 

.02L  ± .85 

.03L  ±.24 

LAX  - ORD  Combined 

.03R  ± .22 



- 

All  Segments  Combined 

.06R  j.  .59 

.03L  ±.26 
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2)  The  differences  measured  between  manual  and  autopilot 
FTE  in  the  terminal  area  were  less  than  0.1  nm.  Per- 
formance for  these  two  control  modes  is  essentially 
the  same. 

3)  Manual  and  autopilot  data  in  the  enroute  flight  regime 
differed  markedly.  However,  due  to  very  limited  data, 
it  is  not  possible  to  comment  on  the  reliability  of  the 
measured  differences. 

4)  Autopilot  FTE  in  the  enroute  mode  was  ±0.26  nin.  The  9t> 
confidence  interval  for  this  data  was  from  .14  to  .38  nm 
due  to  the  limited  number  (9)  of  flights.  However,  this 
compared  favorably  with  the  Collins  and  Delco  terminal 
area  results  which  had  more  acceptable  sample  sizes. 

3.1.4  FTE  For  Minimum  General  Aviation  Type  RHAV  Systems 

The  next  question  to  be  addressed  regarding  the  magnitude  of  FTE  is  re- 
lated to  the  performance  of  minimum  capability  RNAV  systems.  The  data 
selected  for  this  analysis  was  the  King  KN  74  single  waypoint  system  flown 
in  an  Aero  Commander  500  at  Stapleton  International  Airport,  Denver, 

Colorado  and  at  Miami  International  Airport,  Miami,  Florida.  This  data  was 
the  most  applicable  data  related  to  the  operational  capabilities  of  the  min- 
imum system  since  the  tests  were  performed  in  actual  teniiinal  area 
environments.  Similar  data  was  available  from  the  experiments  conducted  with 
the  Butler  VAC/ADD  RNAV  system  in  a Gulfstream  I at  NAFEC  and  in  a Beechcraft 
Twin  Bonanza  at  the  University  of  Illinois.  However,  this  system  was  a two 
waypoint  system  and  did  not  represent  the  minimum  RNAV  capability  on  today's 
market.  The  results  of  the  NAFEC  and  University  of  Illinois  two  waypoint 
data  will  be  presented  subsequently  in  the  discussions  of  along  radial  vs. 
cross  radial  flying  and  cockpit  simulator  vs.  flight  test  FTE,  respectively. 
These  sections  may  be  referred  to  for  additional  specific  data  regarding 
terminal  area  FTE  with  an  analog  RNAV  system  based  on  VOR/DME  inputs.  How- 
ever, as  indicated  in  Tables  3.3  and  3.6  previously,  no  significant  differences 
existed  in  the  magnitude  of  FTE  for  these  two  experiments  compared  to  the 
King  KN  74  Miami  and  Denver  experiments. 

As  already  stated,  the  KN  74  is  a single  waypoint  system  which  repre- 
sents the  minimum  capability  system  from  a waypoint  storage  viewpoint.  This 
fact  inherently  imposes  the  highest  level  of  pilot/RNAV  computer  interaction 
whenever  waypoint  input  is  required.  This  workload  becomes  extremely  impor- 
tant in  the  terminal  area  where  waypoints  are  closely  spaced  especially  for 
single  pilot  operations.  Generally,  terminal  area  arrival  and  departure  way- 
points  are  separated  by  less  than  20  nm.  At  120  knots  (2  nm/min)  true  air- 
speed, this  results  in  a requirement  to  update  the  waypoint  (,',  e)  input  to 
the  RNAV  computer  at  least  once  every  ten  minutes.  This  workload  coupled 
with  the  increased  air  traffic  density,  the  increased  communications  re- 
quired in  the  terminal  area,  the  responsibi 1 ty  to  maintain  appropriate  air- 
craft altitude  and  airspeed,  and  to  prepare  the  aircraft  conf iguration  for 
landing  should  produce  a very  high  workload  situation  and  adversely  affect 
the  pilot's  track  keeping  ability  as  indicated  by  measured  FTE.  It  should 
be  noted  that  the  enroute  data  presented  in  Table  3.4  for  general  aviation 
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was  limited  in  segment  length,  however,  a representative  increase  of  FTE  from 
10  to  19"  was  deemed  reasonable  for  terminal  area  operations. 


Table  3.9  summarizes  the  magnitudes  of  FTE  encountered  in  the  Miami  and 
Denver  flight  tests.  Data  is  shown  aggregated  across  all  flights  on  each 
RNAV  STAR  flown  as  well  as  aggregated  for  all  the  Miami  STARs,  all  the  Denver 
STARS  and  an  aggregate  for  each  terminal  area.  (The  charts  for  these  STARs 
are  provided  in  Appendices  C and  D).  The  magnitude  of  two-sigma  FTE  was  quite 
repeatable  for  both  the  Miami  and  Denver  data  (*1.08  and  *1.00  nm  respectively). 
Similarly,  the  tendency  of  pilots  to  fly  to  the  right  of  desired  course  by 
slightly  more  than  0.1  nm  was  measured  on  both  these  tests.  This  tendency 
has  also  been  measured  during  previous  testing  at  the  University  of  Illinois 
on  the  Butler  system  [3,5].  Viewed  in  the  overall  picture  presented  by  Table 
3.9,  this  data  is  not  reliably  different  from  the  1.0  nm  FTE  error  budget 
recomiiended  by  the  Task  Force.  Comparing  the  '1.05  nm  aggregated  total  FTE 
for  Miami  and  Denver  with  the  King  KN  74  system  to  the  .*.0.95  nm  FTE  two-sigma 
on  the  Butler  system  shows  the  expected  trend  of  slightly  higher  FTE  for  the 
single  vs  the  dual  waypoint  system.  The  95%  confidence  intervals  for  these 
two  data  sets  are  .81-1.29  for  the  King  and  .78-1.12  for  the  Butler  indicating 
that  from  a confidence  level  viewpoint  the  FTE  variability  is  almost  the  same 
for  both  systems.  This  is  not  surprising  since  both  are  general  aviation  type 
systems  and  should  perform  comparably. 


Table  3.9  Oneration^.l  Evaluation  of  FTE  for  Minimum  Systems 


Route  Segment 

FI ight  Technical 
Error 

Statistics 

Mean  ±2o 

MIAMI  TERMINA 


New  River  Frog 
Pi ke/Cl ub 


Aggregate  Miami 


DENVER  TERMINAL  AREA 


Trail  North/Sloan 
Trail  South/Sloan 
Trai 1/Fred 
Shawn/Fred 
Longs/Golf 
Trail/Golf 

Aggregate  Denver 
Aggregate  Terminal  Area 


O.llR  ±0.90 
0.16R  ±1.16 


0.14R  ±1.08 


O.OIL  *0.62 
0.23R  *0.74 
0.05R  *0.62 
0.03L  *0.76 
0.20L  j.0.42 
0.20R  *1.20 


O.IOR  *1.00 


0.13R  '1.05 


3.1.5  Qual i ta t i ve  £JE_ Cons i derat Ipnj^ 

In  addition  to  the  precise  quantitative  analysis  of  FTE  statistics,  the 
results  obtained  on  the  minimum  capability  RNAV  system  can  be  used  to  demon- 
strate some  interesting  qualitative  FTE  aspects.  Figures  3.2  and  3.3  show 
individual  flights  over  the  PIKE  ONE  RNAV  ARRIVAL-CLUB  TRANSITION  by  subject 
pilots  A and  B respectively.  The  primary  reason  for  selecting  these  partic- 
ular flights  was  to  illustrate  the  differing  pilot  techniques  which  impact 
flight  technical  error  measurement  and  analysis.  Both  of  these  figures  show 
actual  aircraft  track  (solid  black  radar  track)  and  RNAV  indicated  position 
(dotted  RNAV  line).  In  addition,  the  current  *2.0  nm  airspace  boundary  and 
the  recommended  '1.5  nm  Task  Force  terminal  area  boundary  are  indicated. 

Figure  3.2  illustrates  the  effect  on  actual  aircraft  track  when  a pilot  pays 
close  attention  to  the  CDI  needle.  The  scale  factor  on  the  GDI  used  for  these 
tests  was  *-5.0  nm  full  scale  deflection  which  equaled  1 dot  per  nautical  mile 
on  the  KNI520  indicator.  Subject  pilot  A consistently  responded  to  CDI  de- 
flections less  than  1 dot  throughout  this  arrival.  This  produced  an  actual 
aircraft  track  that  was  somewhat  sinusoidal  in  character  and  although  small 
deviations  from  desired  track  were  typical,  the  pilot  was,  in  essence,  "chas- 
ing the  needle".  The  sinusoidal  trend  begins  at  Harris  waypoint  where  the 
subject  pilot  responds  to  a one  dot  fly  left  coiiimand  when  his  radar  position 
is  actually  one  quarter  of  a mile  left  of  track.  The  difference  between 
RNAV  indicated  position  and  radar  traces  is  representative  of  navigation  system 
error  (NCT  definition  in  Section  1.0)  and  is  a composite  measure  of  VOR/DME 
sensor  and  RNAV  computer  errors.  The  sinusoidal  trend  continues  to  the  missed 
approach  waypoint  but  is  especially  obvious  on  the  BAKER  to  FROG  route  segment. 
For  comparison  purposes,  it  is  interesting  to  note  that  the  FTE  statistics 
aggregated  along  this  route  segment  for  this  single  flight  resulted  in  a 
0.20R  nm  bias  and  a -0.70  nm  two-sigma  FTE.  Actual  position  errors  correspond- 
ing to  this  FTE  were  0.10  L and  *0.44  nm  two-sigma. 

In  contrast  to  the  sinusoidal  response  to  small  CDI  needle  deflections 
just  discussed.  Figure  3.3  illustrates  a pilot  technique  which  is  significantly 
different  over  the  same  route.  Subject  pilot  B tends  to  manually  filter  out 
even  larger  CDI  deflections  than  encountered  by  subject  A.  For  example,  the 
RNAV  indicated  position  at  the  beginning  of  this  flight  shows  a 2 dot  fly  left 
command.  At  this  point  the  pilot  responds  with  a heading  change  as  directed 
by  the  CDI  needle.  However,  the  heading  change  was  much  less  than  that  used 
by  pilot  A when  a less  than  1 dot  CDI  deflection  was  noted  at  Harris.  There  is 
simply  a difference  in  basic  flying  technique  between  the  two  pilots  which  has 
interesting  effects  on  both  the  actual  aircraft  track  and  on  statistical  FTE 
results.  It  can  be  further  noted  that  large  CDI  fly  Teft  commands  (approxi- 
mately 2 dots)  are  again  ignored  after  the  (p,  o)  input  for  FROG  waypoint  (1) 
and  after  initiating  the  OBS  change  and  (p,  o)  input  to  Cooper  (2).  The 
statistics  for  the  BAKER  to  FROG  segment  on  subject  B's  flight  show: 

Two^i^ma  B^as 

FTE  = ‘0. 2 nm  1 . 6R  nm 

Actual  CTD  = *0.1  nm  0.5  nm 


J 


Repeating  the  statistics  for  subject  A: 


! Two-Sigma 

il  

f j FTE  » ±0.7  nm 

Actual  CTO  = ±0.44  nm 

The  impact  of  the  filtering  performed  by  subject  B (Figure  3.3)  was  therefore 
i to  reduce  both  two-sigma  FTE  and  actual  position  errors.  The  larger  bias 

errors,  especially  the  1.6R  nm  FTE  bias,  were  due  primarily  to  the  CDI  discon- 
tinuity after  the  (p , 6 ) input  for  FROG  waypoint.  This  RNAV  equipment  From/To 
I discontinuity  which  caused  this  1.6R  nm  bias  will  be  covered  in  Section  3.9. 

I A second  reason  for  the  0.5R  nm  bias  in  actual  position  was  the  pilot's  disre- 

I gard  of  a continual  fly  left  command  of  from  0.4  dots  to  0.7  dots  while  flying 

i ' in  the  from  mode  after  passing  BAKER  waypoint. 

I Due  to  the  observed  discontinuities  and  sinusoidal  data  characteristics 

1 just  discussed,  it  was  decided  to  check  repeatability  of  this  data  over  the 

two  Miami  arrival  routes  tested.  Figures  3.4  and  3.5  are  composite  RNAV  indi- 
cated (CDI)  position  traces  for  the  twelve  flights  over  the  NEW  RIVER  and  PIKE 
STARS  respectively. 

Figure  3.4  is  a composite  of  the  NEW  RIVER  STAR  flights.  This  plot  is 
presented  to  illustrate  the  repeatability  of  the  flight  test  FTE  data  and  to 
qualitatively  verify  the  statistical  results  presented  in  Table  3.9which  showed 
, two-sigma  FTE  of  ±0.90  nm.  It  should  be  noted  that  all  the  data  is  indeed 

within  the  ±1.0  nm  AC  90-45A  limits.  This  figure  also  shows  that  there  is 
very  little  change  in  FTE  when  executing  shallow  turns  compared  to  straight 
segment  FTE.  The  two  turns  illustrated  are  30°  left  at  FROG  and  55°  left  at 
COOPER  waypoint. 

Figure  3.5  is  a composite  of  12  flights  using  the  PIKE  ONE  STAR.  The 
two  individual  flights  discussed  previously  used  this  route.  This  compos- 
ite shows  several  important  characteristics  regarding  FTE  using  a single  way- 
point  system  over  a typical  RNAV  STAR  including  downwind,  base,  and  final 
approach  route  segments.  First  of  all,  in  the  HARRIS  to  BAKER  route  segment 
the  steady  state,  straight  segment  FTE  character  is  verified.  The  statistics 
for  this  route  segment  aggregated  across  the  12  flights  resulted  in  a two- 
sigma  FTE  of  ±0.8  nm  and  a slight  right  of  course  bias  indication  of  0.15R. 

The  magnitude  of  these  numbers  is  qua'' itati vely  verified  by  the  illustrations 
for  this  route  segment.  Unfortunately , the  next  three  route  segments  (BAKER 
to  FROG,  FROG  to  KROME  and  KROME  to  COOPER)  do  not  produce  such  a straight- 
forward substantiation  of  statistical  results.  These  segments  do  visually 
verify  the  existence  and  repeatability  of  several  recurring  FTE  phenoroene. 

The  most  striking  feature  of  the  BAKER  to  FROG  route  actually  occurs  in  the 
BAKER  to  CLUB  portion  of  this  route.  That  is,  the  overall  character  of  the  FTE 
envelope  indicated  by  the  shading  in  Figure  3.5  has  a distinctive  sinusoidal 
appearance.  This  sinusoidal  character  is  also  evident  in  the  HARRIS  to  BAKER 
segment  but  the  amplitude  limits  are  more  constrained.  If  attention  is  concen- 
trated on  the  area  where  RNAV  flight  "To  FROG"  was  generally  initiated,  a single 
period  cosine  wave  form  starts  at  this  point  and  terminates  just  prior  to  COOPLR. 
Part  of  the  reason  for  the  gxistence  of  this  shape  is  the  quick  response  to 


Bias 

0.2R  nm 
O.IL  nm 
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Figure  3.5  COMPOSITE  FTE  DATA  - PIKE  RNAV  ARRIVAL 


small  needle  deflections  characteristic  of  pilot  A in  these  tests.  However, 
the  primary  reason  for  the  large  FTE  (actually  GDI  deflection  is  a more 
correct  definition  in  this  case)  is  due  to  the  repeatable  RNAV  system  "From- 
To"  discontinuity  which  was  found  on  the  RNAV  system  used  in  these  tests. 

This  discontinuity  will  be  quantified  and  discussed  thoroughly  in  Section  3.9. 

For  the  present  analysis  of  Figure  3.5  it  was  necessary  to  point  it  out  as 
the  primary  source  of  the  FTE  (needle  deflections)  which  exceed  the  1.0  nm 
AC  90-45A  limit  after  waypoint  update  "To"  FROG.  What  generally  occurred  was 
a 1 to  2 dot  GDI  jump  between  the  area  where  each  pilot  was  flying  "From" 

BAKER  and  the  indication  immediately  following  waypoint  (p,  0)  input  to  FROG. 

As  can  be  seen  in  the  figure,  the  pilot's  reaction  to  the  sustained  "Fly  Left" 
command  eventually  led  to  overshooting  a centered  needle  position.  This  over- 
shoot was  then  followed  by  the  "Fly  Right"  command  which  produced  a second 
overshoot  of  track  centerline  and  the  last  half  of  the  cosine  type 
characteristic.  In  summary,  the  sinusoidal  character  of  the  FTE  variation  is 
illustrated  in  both  the  good  steady  state  data  from  HARRIS  to  BAKER  and  in  the 
FTE  data  which  exceeds  the  1.0  nm  FTE  limit  from  BAKER  to  COOPER.  The  magni- 
tude of  the  latter  GDI  needle  excursions  were  primarily  due  to  the  RNAV 
guidance  discontinuity  mentioned. 

A third  point  of  interest  shown  in  Figure  3.5  is  FTE  during  90°  turns 
such  as  at  FROG  and  KROME  waypoints.  First  it  should  be  pointed  out  that 
there  are  only  six  flights  plotted  at  these  corners  instead  of  the  twelve  on 
the  rest  of  the  STAR.  (The  intent  here  is  qualitative.  Turn  Performance 
will  be  quantified  in  Section  3.2.)  This  is  due  to  "Direct-To"  commands 
issued  by  ATC  which  sequenced  the  RNAV  aircraft  either  direct  to  COOPER  from 
present  position,  direct  to  COOPER  via  CLUB  or  direct  to  COOPER  from  FROG. 

This  "Direct  To"  data  will  be  presented  in  Section  3.4.  The  90°  turn  perform- 
ance for  the  on  course  fl ights  documents  significantly  poorer  performance  than  the 
smaller  angle  turns  shown  on  Figure  3.4  for  the  NEW  RIVER  arrival.  The  large 
CDI  needle  excursions  at  FROG  waypoint  are  in  general  characteristic  of  the 
higher  workload  involved  with  slowing  the  aircraft  down,  control  trim  and  way- 
point  update  requirements  on  a relatively  short  (7  nm)  base  leg.  The  large 
CDI  deflections  (turn  overshoot  indication)  after  passing  KROME  are  at  least 
parfally  attributable  to  this  same  reason.  However,  this  particular  data 
consists  of  five  flights,  all  of  which  are  from  subject  pilot  C.  This  sub- 
ject was  a 6500  hour  instrument  rated  charter  pilot.  His  conventional  IFR 
procedures  were  to  not  initiate  his  turn  until  he  had  an  indication  that  the 
fix  had  been  passed.  These  procedures  carried  over  into  his  RNAV  flying.  No 
attempt  was  made  to  influence  any  of  the  subjects'  flying  technique  in  order 
to  obtain  representative  FTE  data  from  an  unbiased  viewpoint. 

A fourth  point  of  interest  is  the  precision  of  the  final  approach  FTE 
on  the  COOPER  to  MAP  route  segment.  This  segment  on  both  Figures  3.4  and 
3.5  was  flown  in  the  approach  CDI  sensitivity  of  *1.25  nm  full  scale  deflec- 
tion or  ±0.25  nm  per  dot.  Statistical  analysis  resulted  in  a two-sigma  FTE 
of  ±0.48  nm  with  a O.Il  nm  right  of  course  bias.  The  Students  ttest  for  sta- 
tistic significance  for  the  O.llR  nm  bias  error  shows  that  there  is  a 95 
confide.  ,e  level  that  the  population  mean  FTE  for  all  systems  of  this  type 
would  lie  between  0.03  nm  and  0.19  nm  to  the  right  of  course.  This  would 
indicate  that  FTE  in  the  final  approach  mode  would  be  0.67  nm  at  the  upper 
limit  of  the  confidence  interval  (0.19+0.48  nm).  It  appears  then,  that  the 
*0.5  nm  recommended  final  approach  error  budget  value  of  AC  90-4 5A  should  be 
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examined  further.  A more  detailed  discussion  of  final  approach  FTE  and  the 
impact  of  3D  area  navigation  workload  on  lateral  FTE  will  be  presented  in 
Section  3.8  where  workload  interactions  are  discussed.  The  Miami  final  ap- 
proach statistics  were  verified  by  the  results  from  Denver  which  yielded  a 
0.17R  nm  bias  and  *0.52  nm  FTE.  The  Miami  results  were  based  on  24  flights 
and  Denver  on  14  flights. 

3.1.6  The  Definition  of  Steady  State  FTE 

The  final  point  which  must  be  discussed  regarding  the  data  shown  un 
Figure  3.5  as  well  as  FTE  data  reduction  in  general  is  how  steady  state  FTE 
is  defined  for  data  analysis  and  discussion.  In  general,  steady  state  FTE 
is  considered  to  be  the  value  which  quantifies  a pilot's  course  tracking 
ability.  FTE  is  measured  and  quantified  using  the  deflection  of  a cross  track 
deviation  needle  (GDI).  For  this  reason,  any  spurious  GDI  needle  deflections 
which  are  traceable  to  sources  other  than  the  pilot  should  not  be  included  in 
comparing  the  magnitude  of  FTE  to  error  budget  standards  such  as  AGgu-45A. 

The  data  used  in  this  analysis  was  edited  and  GDI  needle  deflections  were  not 
included  in  FTE  statistics: 

1)  During  turns. 

2)  During  DBS  changes. 

3)  During  (p,  e)  waypoint  input. 

4)  Immediately  following  waypoint  update  where  the  "From-To"  discon- 

tinuity was  causing  step  changes  in  pre-update  and  post-update 
GDI  deflection. 

5)  During  ATG  vectoring  or  RNAV  track  acquisition  procedures  following 
vectors. 

6)  During  and  immediately  following  procedural  turns  or  teardrop  turns. 

The  most  significant  quantities  of  data  were  deleted  for  reasons  1)  and  4). 

In  both  of  these  areas  FTE  data  was  edited  using  stabilized  aircraft  heading  as 
an  indication  that  the  subject  pilot  was  satisfied  with  completion  of  the  turn 
or  waypoint  update.  When  heading  was  not  recorded  mechanically,  the  stabilized 
radar  position  was  used  to  indicate  constant  heading.  As  a matter  of  record, 
the  maximum  data  deleted  never  exceeded  2.5  nm  past  the  waypoint  upon  completion 
of  a turn.  For  all  24  flights  this  translates  into  6.1'»  deletion  of  recorded 
FTE  data  from  the  steady  state  analysis. 

In  order  to  document  the  impact  of  deleted  data.  Table  3. 10  was  created. 

This  table  illustrates  two  primary  poi nts . First,  the  impact  of  the  data  edit- 
ing techniques  on  mean  and  two-sigma  FTE  was  very  minor.  This  is  verified  by 
inspection  of  the  terminal  area  and  approach  statistics  for  "ALL  ARRIVAL  DATA", 
by  the  data  classified  by  STAR,  for  the  longest  route  segment  on  a given  STAR 
and  on  a per  subject  basis  for  subjects  A and  B.  Second,  the  most  significant 
reduction  in  FTE  was  0.28  nm  for  subject  G between  steady  state  and  worst  case 
statistics.  This  subject's  experience  and  turn  procedures  have  been  mentioned 
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Table  3.  10 


COMPARISON  OF  STEADY  STATE  AND  UNEDITED  (Worst  Case)  FTE  RESULTS 
(All  Data  1 nm/ Dot  Sens! tivi ty  Expept  Final  Approach) 


MIAMI 

Terminal  Area 

Two-Siq 

ma  FTE 

Mean  Errors 

Steady 

State 

Worst 

Case 

Steady 

State 

Worst 

Case 

All  Arrival  Data  (24  Flights) 

Terminal  Area 

1.08 

1.20 

0.14R 

0.13R 

Final  Approach  (0.25  nm/Dot) 

0.48 

0.50 

O.llR 

O.IOR 

New  River  Arrival  Only 

0.90 

1.08 

O.llR 

0.13R 

Pike  Arrival  Only 

1.16 

1.28 

0.16R 

0.13R 

Longest  Route  Segment  Data 

New  River  to  Frog  Waypoint(22.5  nm) 

0.92 

1.16 

0.09R 

0.13R 

Baker  to  Frog  Waypoint  (24.1  nm) 

1.10 

1.24 

O.IOR 

0.04R 

By  Subject  Pilot 

A (400  Hours) 

0.92 

1.00 

0.14R 

0.12R 

B (3000  Hours) 

1.50* 

1.46 

0.34R 

0.22R 

C (6500  Hours) 

1.02 

1.30 

0.07R 

0.12R 

*/N0TE/  Subject  B only  flew  4 flights  while  subjects  A and  C each  flew 
10  flights.  The  non-representativeness  of  this  limited  sample 
is  reflected  in  both  an  increased  mean  and  an  inflated  two-sigma 
FTE. 


previously.  As  a result  of  these  turn  procedures,  the  largest  amount  of  data 
was  deleted  from  this  subject's  FTE  statistics.  In  fact,  9.2  of  subject  C's 
data  was  deleted  compared  to  only  3.b%  for  subject  A and  4.5  for  subject  B. 
Subject  C's  poor  turn  performance  will  again  be  discussed  under  airspace  uti- 
lization in  Section  3.6.  However,  it  was  not  felt  that  this  turn  data  should 
be  reflected  in  steady  state  FTE  statistics. 

An  additional  and  more  analytical  method  of  determining  the  impact  of 
data  editing  is  to  plot  histograms  or  frequency  distribution  plots  for  the  two 
data  bases  which  were  compiled  and  classified  as  steady  state  and  worst  case 
FTE.  Figures  3.6  and  3.7  show  these  two  plots.  Normal  curves  with  appropri- 
ate means  and  standard  deviations  are  superimposed  on  these  plots.  Both  the 
steady  state  and  the  worst  case  data  sets  appear  to  be  normally  distributed 
with  means  very  close  to  zero.  Additional  FTE  data  shown  in  References  11 
and  23  verify  the  apparent  normal  distributions  illustrated  in  Figures  3.6 
and  3.7.  The  steady  state  data  indicates  a right  bias  of  0.14R  nm  (skewness) 
and  the  worst  case  0.13R  nm.  For  this  analysis,  a fly  left  command  was 
recorded  as  a negative  FTE  and  fly  right  as  positive.  The  negative  means 
therefore  indicate  a slight  tendency  for  the  pilots  to  fly  to  the  right  of  de- 
sired course  which  results  in  a negative  or  fly  left  recorded  GDI  position. 
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Unedited  (Worst  Case)  FTE  Figure  3.7  Steady  State  FTE  Frequency 
Frequency  Distribution  Miami  Distribution  Miami  Flight 
FI ight  Test  Test 


The  primary  effect  of  steady  state  editing  is  to  eliminate  outlier  data  as  indi- 
cated by  the  shaded  data  'points  on  Figure  3.6.  Second,  the  variability  of  the 
data  is  reduced  slightly  as  indicated  by  the  narrower  normal  distribution  in 
Figure  3.7  and  the  smaller  two-sigma  FTE.  One  point  should  be  made  regarding 
the  resolution  of  Figures  3.6  and  3.7.  Due  to  the  plotting  technique  utilized, 
each  data  point  shown  in  the  histograms  does  not  represent  a single  data  point. 
Therefore,  direct  calculation  of  the  normal  curves  shown  cannot  be  done  by 
counting  the  symbols  plotted  on  these  curves.  Rather,  both  the  plot  and  the 
normal  curve  were  calculated  from  raw  data. 

3.1.7  Display  Effects  on  FTE  Magni tude 

A number  of  outside  factors  related  to  cockpit  displays  are  known  to  in- 
fluence flight  technical  error.  These  factors  include; 

1)  Display  Sensitivity  or  Scale  Factor  (nm/dot). 

2)  Display  Type  (Linear  or  Angular  Deviation). 

3)  Display  Complexity  (CDI,  HSI,  SPI,  FD,  etc.). 

Cockpit  simulator  experiments  have  been  performed  by  the  University  of  Illinois 
regarding  these  three  factors.  The  specific  reference  for  these  items  was 
entitled  "Pilotage  Error  in  Area  Navigation:  Effects  of  Symbolic  Display 
Variables"  [6].  This  report  included  flight  testing  of  CDI  versus  HSI  perform- 
ance, and  cockpit  simulator  testing  of  linear  versus  angular  displays  and  dis- 
play scale  factor  variations  from  0.1  nm/dot  to  2.5  nm/dot.  The  discussion 
which  follows  will  summarize  the  highlights  from  these  previous  experiments 
and  where  necessary  suggest  the  need  for  further  evaluation.  The  reader  should 
consult  the  primary  reference  stated  for  a more  thorough  treatment  of  each  of 
these  display  factors  and  the  impact  on  FTE. 

D j sp_l ay  Sensitivity  _E_f f e c_t_l 

Reference  10  (DO-140)  includes  display  sensitivity  in  a group  of  variables 
that  "affect  pilotage  directly  and  measurably".  This  seems  quite  reasonable 
since  the  level  to  which  FTE  is  being  limited  should  appear  as  a significant 
deflection  of  the  deviation  indicator  but  something  less  than  full  scale. 
Otherwise  a pilot  might  either  fail  to  detect  a small  display  deflection  or  he 
might  overreact  to  a full  scale  deflection.  In  many  of  the  existing  RNAV  sys- 
tems the  scale  factor  of  the  displayed  information  is  changed  between  the  en- 
route  and  approach  condition  to  assist  in  meeting  the  FTE  requirements. 

As  previously  stated,  the  relationship  of  scale  factor  and  FTE  was  inves- 
tigated with  a linear  display  in  the  simulator  experiment  at  the  University  of 
Illinois.  Prior  to  formal  experimentation,  a great  deal  of  pretesting  was  done 
using  various  scale  factors  in  an  effort  to  establish  extreme  and  near  optimum 
values  of  scale  factor  for  a range  of  course  intercept  values  as  well  as  straight 
course  tracking.  As  a result  of  this  pretesting,  the  scale  factors  of  0.1, 

J-'A (nm)  between  needle  deflection  dots,  spaced 
at  0.22-inch  intervals,  were  selected  for  the  formal  experiment.  These  scale 
factors  resulted  in  full-scale  deflections  of  ‘5  dots  ranging  from  ‘0.5  nm  to 


^12.5  nin.  Pretest  observations  indicated  that  this  range  of  scale  factors  in- 
cluded the  most  extreme  values  that  might  be  considered  acceptable  for  all 
angles  of  course  intercept. 

During  the  experiment,  cross  track  deviation  was  measured  every  10  sec- 
onds during  flight.  At  an  airspeed  of  180  knots,  this  yields  a measurement 
every  0.5  nm.  the  data  was  recorded  directly  in  digital  form  on  magnetic  tape 
by  the  Raytheon  704  computer.  GAT-2  position  was  simultaneously  monitored  on 
an  x-y  plotter  as  a cross-check  to  establish  instrumentation  system  validity. 

Cross  track  errors  were  measured  relative  to  route  centerlines  drawn  be- 
tween successive  waypoints,  not  relative  to  individual  waypoints  and  their 
corresponding  inbound  and  outbound  radials.  As  a result,  errors  measured  in 
this  cockpit  simulator  experiment  include  any  small  errors  in  setting  the  "TRACK' 
selector  on  the  SPI.  No  attempt  was  made  to  separate  the  centering  error  and 
the  DBS  setting  error.  The  reasoning  for  this  was  that  these  errors  were  a 
valid  part  of  the  total  pilotage  error  assessment.  The  following  formula  was 
used  to  calculate  o which  amounts  to  taking  the  square  root  of  the  unbiased 
estimator  for  the  population  variance: 

- [ t . X - NP|2 

1 1 


where  Xj  is  the  value  of  the  i^h  sample  and  M is  the  sample  mean  with  N being 
the  number  of  samples.  The  root  mean  square  (RMS)  error  on  outbound  tracking 
from  a point  eight  nm  beyond  each  waypoint,  following  which  there  was  no  longer 
any  bias  in  cross  track  error  due  to  undershooting  or  overshooting  the  preceding 
turn,  was  computed  using  the  following  formula: 

RMS  = 

The  average  RMS  values  were  calculated  by  summing  the  individual  mean  squared 
values  along  the  course  line,  dividing  by  the  number  of  samples,  and  taking  the 
square  root  of  this  result. 

Advisory  Circular  AC  90-45A  assumes  a 2 RMS  pilotage  error  of  ^1.0  nm  for 
terminal  area  steering.  Table  3.11  shows  the  RMS  values  of  steering  error  for 
a steady  state,  straight  course  tracking  situation.  Even  in  the  worst  cases, 
error  values  measured  were  less  than  half  the  tolerance  value  given  in  the  Ad- 
visory Circular.  Although  error  increased  sharply  with  a scale  factor  of  2.5 
nm  per  dot  for  the  linear  display  with  integral  heading,  this  result  was  not 
evident  with  the  same  scale  factor  for  the  linear  display  without  integral  head- 
ing presentation. 

As  shown  in  Table  3.11,  the  use  of  differing  scale  sensitivities  for  linear 
indications  of  course  deviations  had  no  differential  effect  on  pilot  steering 
performance.  However,  the  scale  factors  of  0.1  and  0.25  appeared  to  result  in 
a display  that  was  uncomfortable  to  use  and  caused  an  excessive  number  of  course 
corrections.  Ideally,  scale  factor  should  be  as  sensitive  as  is  compatible  with 
a reasonable  pilot  workload.  The  testing  showed  that  pilots  were  able  to  adjust 
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Table  3.11 


2RMS  ERRORS  FOR  STRAIGHT  COURSE  TRACKING  AS  A FUNCTION 
OF  DISPLAY  CONFIGURATION  AND  SCALE  FACTOR 


'DISPLAY  SENSITTVITY’ 

2RMS  ERRORS  IN 

NAUTICAL  MILES 

(Separation  Between 
Dots  Was  0.22  Inches) 

Linear  Display 
With  Heading 

Linear  Display 
Without  Heading 

0.10  nm/dot 

0.19 

0.33 

0.25  nm/dot 

0.27 

0.36 

1.0  nm/dot 

0.20 

0.42 

2.5  nm/dot 

0.50 

0.34 

to  a wide  range  of  scale  factors,  ranging  f I'om  0.1  nni  per  dot  to  2.5  nm  per 
dot  without  incurring  a significant  degradation  of  steering  performance. 
Steering  performance  was  judged  in  terms  of  cross  track  error.  However,  the 
results  also  indicated  that  the  pilots  did  not  adjust  with  equal  comfort  to 
the  scale  factors  tested.  Insensitive  indications  presented  a visual  percep- 
tion problem  and  very  sensitive  settings  created  a stability  problem;  both 
conditions  required  increased  attention  on  the  part  of  the  pilot.  Of  the  scale 
factors  values  studied,  0.1  nm  per  dot  and  0.25  nm  per  dot  were  judged  to  be 
too  sensitive  and  0.5  nm  per  di^t  was  selected  for  use  in  continued 
experimentation.  This  value  gave  a full-scale  reading  of  -'.2.5  nm  on  the  devi- 
ation indicator.  In  current  RNAV  implementation  plans  (AC  90-45A,  and  the  Task 
Force  Report),  FTE  is  assigned  different  values  in  different  flight  situations 
such  as  2 nm  enroute,  1 nm  in  the  terminal  area  and  0.5  nm  for  approach.  It  is 
anticipated  that  variable  scale  factor  capability  will  be  desirable  in  RNAV 
equipment  to  assist  in  holding  FTE  within  tnese  defined  values.  The  current 
trend  in  RNAV  hardware  mechanizations  is  to  provide  separate  selectable  scale 
factors  as  a function  of  airspeed. 

The  results  summarized  from  the  cockpit  simulator  experiment  were  used  to 
select  0.5  nm/dot  as  a compatible  display  sensitivity  based  on  cross  track  ac- 
curacy and  pilot  workload  considerations.  However,  the  2RMS  values  tabulated 
in  Table  3.11  indicate  only  minor  differences  between  0.1,  0.25  and  1.0  nm/dot. 
In  fact,  a literal  interpretation  of  the  data  for  a linear  display  with  inte- 
gral heading  indicates  no  difference  between  0.1  and  1.0  nm/dot  2RMS  steering 
errors.  It  would  be  reasonable  to  assume  that  some  minimum  point  might  exist 
between  these  two  values  based  on  practical  considerations  such  as  visual  per- 
ception, needle  stability  and  procedural  threshold  levels  of  deflections  neces- 
sary to  produce  a pilot  reaction.  Although  the  data  presented  forms  a valuahlt' 
foundation  for  further  evaluation  of  display  sensitivity,  the  results  of  this 
particular  experiment  are  inconclusive.  In  addition,  flight  test  experimenta- 
tion is  indicated  as  a requirement  due  to  the  relative  insensitivities  measured 
in  the  simulator  experiment.  Such  in-flight  variables  as  wind  effects,  turbu- 
lence and  signal  noise  would  be  expected  to  strongly  influence  the  results  of  a 
display  sensitivity  optimization  study. 
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Effe^tof  Display  Type 


In  the  consideration  of  display  types  (linear  vs.  angular),  the  basic 
feeling  expressed  in  DO  140  is  that  the  particular  type  of  display  is  believed 
to  have  a major  influence  on  FTE.  The  document  states  the  use  of  "linear  (con- 
stant deviation)  displays"  as  a way  to  improve  system  accuracy  by  reducing  FTE. 
This  difference  is  also  reflected  in  the  flight  technical  error  values  of  DO  140. 
FTE  values  ranging  from  2 nm  to  0.2  nm  are  cited  as  achievable  with  various 
combinations  of  equipment  and  flight  conditions.  The  same  document  refers  to  a 
•2.5°  flight  technical  error  value  for  angular  displays  taken  from  Reference  19 
and  adds  that  it  is  likely  to  be  range  dependent;  being  larger  at  long  ranges 
and  smaller  at  short  ranges. 


The  relative  performance  between  linear  and  angular  displays  was  investi- 
gated in  a cockpit  simulator  experiment  at  the  University  of  Illinois  [6j.  The 
experiment  conducted  included  evaluation  of  both  display  types  each  tested  with 
and  without  integral  heading  information.  The  resulting  four  display  configur- 
ations were;  angular  with  integral  relative  heading  information,  angular  with- 
out integral  relative  heading  information,  linear  with  integral  relative  heading 
information,  and  linear  without  integral  relative  heading  information  (see 
Table  3.12). 


Table  3.12  LINEAR  VERSUS  ANGULAR  DISPLAY  EVALUATION  MATRIX 


Angular  With 

Linear  With 

Integral  Heading 

Integral  Heading 

Angular  Without 

Linear  Wi thout 

Integral  Heading 

Integral  Heading 

Each  subject  used  every  display  configuration.  However,  to  avoid  an  nrdm 
effect,  the  sequences  in  which  the  eight  pilots  were  tested  on  the  fou>  displav- 
were  counterbalanced. 

The  scale  factor  used  with  the  linear  display  was  O.S  nm  per  dot  in  bnth 
the  cross  track  and  along  track  dimensions.  This  resulted  in  a 2.S  nm  full- 
scale  deflection.  The  scale  factor  for  the  angula*-  display  was  2 degrees  per  dot 
resulting  in  tlie  ‘Standard  10-degree  full-scale  deflection.  The  almig  track  indi- 
cation in  this  case  remained  linear  with  0.5  nm  per  dot  scale  factor. 

Figure  3.8  presents  the  2a  steering  error  envelopes  of  each  display  for 
course  changes  of  22,  45,  67  and  90  degrees,  respectively.  The  figures  show, 
in  general,  that  increased  airspace  is  required  as  the  angle  between  route  seg- 
ments increases.  This  is  the  expected  result  regarding  airspace  requirements 
as  a function  of  course  intercept  angle.  It  is  evident  that  a course  intercep- 
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tion  of  90  degrees  is  more  difficult  than  one  of  fewer  degrees,  and  this  fact 
has  long  been  recognized  in  the  planning  of  terminal  area  and  approach  procedures. 
However,  the  magnitude  of  error  in  large-angle  intercepts  may  well  be  less  than 
previously  believed.  It  is  evident  that  the  display  configuration  has  little 
effect  on  steady  state  RMS  error  and  also  that  when  all  course-changing  effects 
have  dissipated,  the  assumed  1.0  nm  error  tolerance  given  in  Advisory  Circular 
AC  90-45A  is  easily  achievable. 

Table  3.13  summarizes  the  two-sigma  cross  track  steering  errors  obtained 
from  Appendix  B of  the  University  of  Illinois  report  [6].  The  data  was  aggre- 
gated across  8 flights  from  2 nm  preceding  the  turn  to  6 nm  past  the  turn,  for 
each  display  type/heading  presentation  technique  combination.  This  table  clearly 
substantiates  the  conclusion  that  "no  systematic  differences  appeared  among  the 
tour  display  configurations  tested  until  the  turn  angle  approached  90  degrees". 
Apparently,  at  least  the  first  half  of  this  statement  is  substantiated.  No  con- 
sistent increase  in  two-sigma  cross  track  steering  errors  was  evident  even  for 
the  90°  turn  angles  tested.  This  table  does  not  show  as  sharp  a difference  be- 
tween the  two  display  types  as  might  have  been  expected  but  it  should  be  noted 
that  the  evaluations  were  made  at  relatively  short  distances  from  waypoints  and 
in  a zero  wind,  perfect  VOR  signal  cockpit  simulator  environment.  It  is  reason- 
able to  expect  that  the  angular  display  would  have  been  at  an  even  greater  dis- 
advantage if  the  distances  to  waypoint  had  been  significantly  larger.  The  useful 
operating  range  for  the  angular  display  will  also  be  reduced  as  accuracy 
requirements  are  increased  during  the  period  of  RNAV  implementation. 

An  additional  result  from  these  simulator  tests  was  that  the  integral  rel- 
ative heading  presentation  had  no  systematic  effect  on  steering  performance  with 
either  linear  or  angular  course  deviation  presentations.  The  cockpit  simulator 
results  were  retested  in  flight  using  a GDI  and  an  HSI . This  experimental  data 
is  valuable  for  three  reasons.  First,  the  additional  heading  control  workload 
which  occurs  in  flight  should  impact  the  performance  differences  with  or  without 
integral  heading  displayed  on  the  cross  track  deviation  indicator.  Second,  abso- 
lute magnitude  of  FTE  in  flight  can  be  compared  directly  to  the  simulator  results 
from  linear  displays.  This  is  the  only  direct  comparison  of  flight  versus  simu- 
lator FTE  magnitudes  available  at  this  writing.  Finally,  the  relative  difficulty 
of  turn  performance  as  a function  of  turn  angle  magnitude  can  be  reassessed  in 
flight  where  wind  direction  and  velocity  could  cause  deviations  from  the  no  wind 
cockpit  simulator. 

The  scale  factors  of  the  two  displays  were  approximately  equal.  The  GDI 
indicated  a A- full -scale  deflection  over  five  dots  (0.625  inches),  and 
the  HSI  indicated  a *2. O-niil e ful 1 -seal e deflection  over  the  two  dots  Co.595 
inches) . 

The  experiment  was  designed  so  that  the  overall  differences  due  to  displays 
would  receive  the  most  powerful  test.  Accordingly,  a wi thin-subject  design  was 
employed  in  which  each  pilot  used  each  display  the  same  number  of  times  in  a 
counterbalanced  order  on  four  flights  over  four  courses. 

During  flights  on  which  pilots  used  the  GDI  for  navigation,  he  received 
heading  information  on  a separate  display.  During  the  remainderof  the  flights, 
the  HSi  was  used  which  presents  heading  and  course  deviation  on  the  same 
display.  Each  pilot  flew  two  flights  using  one  display  followed  by  two  flicjhts 
using  the  other  display. 


Table  3.  13 


Two-Sigma  FTE  as  a Function  of  Display  Type 


Display  Type 

Turn 

Angle 

TWO-SIGMA  ERRORS 

IN  NAOTlCAr miles' 

With  Integral 
Heading  Display 

Without  Integral 
Heading  Display 

Linear  Deviation 

90 

.44 

.32 

Linear  Deviation 

67 

.24 

.44 

Linear  Deviation 

45 

.26 

.46 

Linear  Deviation 

22 

.28 

.22 

Angular  Deviation 

90 

.64 

.56 

Angular  Deviation 

67 

.44 

.60 

Angular  Deviation 

45 

.32 

.28 

Angular  Deviation 

.16 

.26 

Table  3.14  FTE  With  Linear  Displays 


Turn 

Angle 

FLIGHT  TEST  RESULTS 

SIMULATOR 

Results 

With  Integral 
Heading  (HSI) 
±Two-SigmaXnml 

Without  Integral 
Heading  (GDI) 
±Two-Sigma(nml 

With  Integral 
Heading  (HSI) 
+Two-Sigma7nm^ 

Without  Integral 
4®A'ilL3_(pD.IJ 
Two  - S Igiiidjn'lll 

90 

.70 

.82 

.44 

.32 

67 

.54 

.60 

.24 

.44 

45 

.58 

.60 

.26 

.46 

22 

.66 

.70 

.28 

.22 

3-36 


Cross  track  errors  were  recorded  continuously  during  the  flight  on  a two- 
channel  strip-chart  recorder.  Distance-to-waypoint  was  also  recorded.  Errors 
in  the  fine  tuning  of  the  course  selector  are  not  included  in  the  flight  data 
because  the  left-right  needle  deflection  was  recorded  instead  of  x-y  position 
for  cross  track  error.  Large  errors  in  course  selector  setting  were  recorded 
as  procedural  errors  and  immediately  corrected.  Cross  track  data  was  lost  at 
miles  8 and  9 after  the  waypoint  because  the  new  waypoint  was  being  set,  and 
it  took  a few  seconds  for  the  DME  to  lock  onto  the  new  station.  In  most  cases 
dependable  data  was  available  at  mile  10  after  the  waypoint  (mile  5 before  the 
next  waypoint). 

In  order  to  show  central  tendency  and  2o  variability  for  cross  track 
error  as  a function  of  distance  from  the  waypoint,  these  values  were  calculated 
from  the  raw  scores  and  plotted  at  the  appropriate  one-mile  intervals.  Graphs 
of  these  results  are  shown  in  Figure  3.9.  Since  there  was  some  improvement  in 
performance  from  the  first  trial  on  a display  to  the  second  trial  on  the  same 
display  it  seemed  appropriate  to  present  data  of  this  form  for  the  trials  after 
most  of  the  learning  had  been  completed.  Accordingly  Figure  3.9  presents  data 
from  the  second  flights  on  a given  display. 

Figure  3.10  presents  central  tendency  and  2a  variability  by  displays  for 
all  angles  combined.  Figure  3.9  presents  central  tendency  and  2-  variability 
by  displays  for  each  of  the  four  turn  angles  used. 

These  figures  show  that  in  level  flight  the  2a  cross  track  errors  measured 
on  miles  0 and  7 were  well  within  the  limits  set  by  FAA  Advisory  Circular  90-^5A 
for  either  of  the  two  displays  tested  for  turn  angles  from  22  degrees  to  90 
degrees.  In  fact,  combining  data  from  all  turn  angles  (Figure  3.10)  resulted  in 
a composite  2a  cross  track  error  of  approximately  one-mile  at  the  widest  point. 
Considering  each  turn  angle  separately,  f^e  one-mile  maximum  variability  was 
exceeded  only  in  the  case  of  the  90  degree  turn.  When  a new  waypoint  was  set 
and  an  off-course  indication  received,  the  2o  cross  track  errors  were  reduced 
to  less  than  one  mile  within  three  miles  along  track  (miles  10  through  13). 

Although  these  graphs  show  a slight  overall  improvement  in  performance 
with  the  FISI,  this  difference  was  not  significant.  However,  the  difference 
in  tracking  errors  between  displays  increased  for  the  larger  turn  angles. 

In  an  effort  to  determine  whether  there  were  any  significant  differences 
between  the  displays  for  the  variables  tested,  and  in  order  to  develop  data 
suitable  for  a direct  comparison  with  cockpit  simulator  results,  the  data  from 
the  interval  2 nm  preceding  the  turn  to  6 nm  after  the  waypoint  was  aggregated 
across  flights.  Table  3.15  presents  these  statistically  aggregated  flight 
test  results,  as  well  as  the  comparable  results  from  the  cockpit  simulator 
experiment. 

An  inspection  of  this  table  and  Figure  3.9  shows  no  significant  differ- 
ences in  pilot  performances  with  one  display  over  the  other.  On  second  trials 
only  there  was  slightly  better  cross  track  steering  perfoniiance  with  the  HSI 
than  with  the  GDI  for  larger  turn  angles.  However,  on  these  same  trials,  alti- 
tude control  was  slightly  better  with  the  GDI  display  than  with  the  HSI.  These 
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DiSTAfJCE  FROM  JAY  POINT  IN  NAUTICAL  MILLS 


Figure  3.10  Central  Tendency  and  2o  Variability  of  Cross  Track  Steering  Error  on  all 
Turn  Angles  on  Second  Flights  Only 
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results  seem  to  indicate  that  for  the  type  of  flight  task  used,  the  addition 
of  integrated  heading  to  the  navigation  display,  though  it  is  desirable  from 

the  pilot's  point  of  view,  does  not  improve  his  flying  performance  significantly.  i 

The  comparison  of  flight  test  data  to  cockpit  simulator  data  shows  a 
variation  in  correlation  from  0.42  to  0.63  for  the  data  with  integral  heading 
and  from  0.31  to  0.77  for  the  data  without  integral  heading.  This  variation 
seemed  random  for  the  turn  magnitudes  shown.  However,  the  average  of  all  turn 
magnitudes  with  integral  heading  showed  a 0.49  correlation  constant  and  the 
data  without  integral  heading  showed  a value  of  0.55.  In  general,  a value  of 
0.5  could  be  used  as  an  estimated  extrapolation  coefficient  to  approximate 

actual  in-flight  FTE  from  cockpit  simulator  data.  This  particular  experiment  I 

is  the  only  source  currently  available  to  derive  such  a coefficient.  However, 
planned  FAA  flight  and  simulator  tests  of  representati ve  RNAV  systems  will  pro- 
vide important  substantiation  of  the  0.5  number  derived  from  the  University  of 
Illinois  experiments. 

1 

Effect  of  Display  Comp 1 ex i ty 

Display  complexity  was  identified  as  the  third  outside  factor  which  in- 
fluences FTE  at  the  beginning  of  this  subsection.  00-140  [10]  specifies  this 

as  an  element  that  can  influence  FTE.  Flight  experience  indicates,  for  example, 
that  a pilot  should  be  able  to  steer  an  aircraft  with  a higher  degree  of  pre- 
cision using  a flight  director  than  with  a GDI.  This  increased  capability  with 
the  flight  director  should  lead  to  lower  values  of  FTE.  Current  testing  of  FTE 
values  and  factors  affecting  FTE  are  largely  related  to  deviation  type 
instruments.  The  values  derived  in  these  tests  should  be  conservative  when 
they  are  related  to  flight  director  performance. 

One  aspect  of  display  configuration  has  received  considerable  attention. 

That  is  the  inclusion  of  heading  information  as  an  integral  part  of  the  infor- 

mation  on  the  navigation  display.  This  data  has  already  been  presented.  Use  , 

of  the  aircraft  relative  heading  information  had  no  systematic  effect  upon 
steering  accuracy  of  the  subjects  tested.  The  result  was  qualified,  however, 
as  representing  only  a moderate  workload  situation.  Test  pilots  expressed  a 

preference  for  the  HSI  with  its  heading  information,  and  the  possibility  exists  j 

that  a significant  difference  between  the  GDI  and  HSI  might  emerge  under  con-  ; 

ditions  of  high  workload. 

Table  3.15  summarizes  the  major  findings  of  the  available  data  regarding 
display  effects  on  FTE. 


TABLE  3. IE  SUMMARY  OF  DISPLAY  EFFECTS  ON  FTE 


LINEAR  DISPLAY 

SENSITIVITY' 

[ DISPLAY  TYPE 

DISPLAY 

COMPLEXITY 

Sens! ti vi ty 
(nm/dot) 

FJE_(_n_mJ 

Turn 

Angle 

Linear 

FTE-nm 

Angular 

FTE-nm 

Turn 

Angle 

HSI 

FTE-nm 

GDI 

FTL-nm 

0.10 

0.19 

220 

.28 

.16 

22° 

.66 

.70 

0.25 

0.27 

45° 

.26 

.32 

45° 

.58 

.60 

1.0 

0.20 

67° 

.24 

.44 

67° 

.54 

.60 

2.5 

0.50 

90° 

.44 

.64 

90° 

.70 

.82 
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Interpretation  of  Table  3.15  shows  that: 

1.  The  use  of  differing  scale  sensitivities  for  linear  indications 
of  course  deviations  of  up  to  1 nin  per  dot  had  no  effect  on 
pilot  steering  performance. 

2.  No  systematic  differences  appeared  among  the  display  configu- 
rations tested. 

3.  No  significant  differences  in  FTE  occurred  between  the  HSI  and 
GDI  tested. 

SUMMARY 

In  order  to  summarize  what  has  been  said  about  the  importance  and  magni- 
tude of  steady  state  flight  technical  error,  the  following  section  by  section 
synopsis  is  provided. 

Section  3.1.1  discussed  the  relative  meaning  of  FTE  tB~.RNAV  system  de- 
signers, airspace  planners  and  RN'IV  users.  The  conclusion  was  reached  that 
FTE  is  still  an  important  RNAV  error  element  for  the  design  and  utilization  of 
airspace  as  designated  in  AC  90-45A  FTE  also  remains  an  explicit  error  budget 
element  within  the  Advisory  Circular  for  one  of  the  three  categories  of  RNAV 
systems  defined.  FTE  is  not  available  for  the  other  two  categories  of  RNAV  sys- 
tems as  far  as  system  compliance  and  error  budget  trade  off  studies  are  concerned. 
Currently,  a discrepancy  exists  between  compliance  criteria  for  these  two  cate- 
gories of  RNAV  systems  and  the  error  budgets  used  for  airspace  planning  which 
include  FTE.  This  discrepancy  leads  to  the  creation  of  a "residual  error", 
the  residual  error  being  the  difference  between  airspace  planned  using  "fix  dis- 
placement" error  tables  which  include  FTE  and  systems  certified  using  system 
compliance  error  tables  which  do  not  include  FTE.  Since  this  residual  error  be- 
comes significantly  large  (approaching  1.0  nm)  for  a 2.0  nm  FTE  error  budget,  it 
is  extremely  important  to  determine  both  whether  a 2.0  nm  or  1.0  nm  FTE  error 
budget  value  is  appropriate,  and  which  of  these  values  is  realistically  attainable. 

Section  3.1.2  discussed  in  detail  the  currently  achievable  magnitudes  of 
steady  state  FTE.  The  presentation  included  a breakdown  of  demonstrated  magni- 
tudes for  three  airspace  regions  and  five  different  RNAV  systems.  The  results 
detailed  in  Table  3.3  are  summarized  in  Table  3.16.  The  Task  Force  suooosition 
that  reduction  of  enroute  FTE  from  2.0  nm  to  1.0  nm  is  achievable  was  substan- 
tiated. Ihe  results  further  indicated  that  a 1.0  nm  FTE  was  achievable  for  ter- 
minal area  operations  for  all  systems  tested.  In  addition,  the  0.5  nm  FTE  error 
budget  for  final  approach  appeared  feasible.  The  FTE  magnitudes  were  analyzed 
by  system  type,  airline  and  general  aviation,  as  well  as  by  airspace  region  to 
further  substantiate  these  conclusions. 

Section  3.1.3  presented  steady  state  data  from  two  airline  quality  RNAV 
systems  regarding  the  relative  performance  in  manual  and  autopilot  modes,  both 
manual  and  autopilot  data  in  the  terminal  area  indicate  FTE  is  significant! v 
less  than  1.0  nm  based  on  a two-sigma  95  confidence  level  analysis.  The  differ- 
ences measured  between  manual  and  autopilot  FTE  in  the  terminal  area  were  less 
than  0.1  nm.  Manual  and  autopilot  data  in  the  enroute  mode  were  also  signifi- 
cantly less  than  the  proposed  -l.O  nm  tolerance.  The  manual  FTE  value  enroute  was 
<0.59  nm  which  was  56  larger  than  the  -0.26  nm  autopilot  enroute  FTE.  Although 
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Table  3.  16 


FTE  SUMMARY  DATA  FOR  ALL  SYSTEMS  TESTED 


FLIGHT  TECHNICAL  ERROR 

Ai rspace 

All  Systems 
- - ^ 

All  Systems 
w/o  Outl ier 

Enroute 

Number  of  FI ights-n 

Two-Sigma  FTE-nm 

95%  Confidence  Interval -nm 

87 

.72 

.61  - .83 

82 

.69 

.58  - .80 

Terminal 

Number  of  FI ights-n 

Two-Sigma  FTE-nm 

95f'  Confidence  Interval -nm 

261 

.88 

.80  - .96 

231 

.74 

.67  - .81 

Approach 

Number  of  FI ights-n 

109 

Not 

Appl icable 

Two-Sigma  FTE-nm 

.43 

Not 

Applicable 

95“'>  Confidence  Interval -nm 

.37  - .49 

Not 

Appl icabl  e 

the  95,  confidence  interval  of  this  data  is  quite  large  due  to  the  small  number  of 
flights  (5  manual  and  9 autopilot),  the  upper  end  of  the  95  confidence  inter- 
val was  still  less  than  the  +1.G  nm  enroute  error  tolerance. 

The  achievable  FTE  magnitudes  for  RNAV  systems  satisfying  the  minimum 
acceptable  operational  characteristics  were  analyzed  in  Section  3.1.4.  Termi- 
nal area  operations  resulted  in  measured  FTE  of  +1.05  nm.  This  data  was  not  sig- 
nificantly different  from  the  1.0  nm  FTt  error  budget  recoiiinienaed  by  the  Task 
Force.  Comparison  of  the  minimum  RNAV  system  to  the  two  waypoint  system  tested 
showed  the  expected  trend  of  slin^t.ly,  but  not  unreal i stical ly . higher  FTE  for 
the  single  versus  the  dual  waypo.nt  system. 

Section  3.1.5  discussed  the  observed  qualitative  aspects  of  flight 
technical  error.  Both  the  individual  flights  that  were  examined  and  the  com- 
posite FTE  data  on  particular  STARs  showed  four  interesting  and  repeatable 
characteristics.  First,  a sinusoidal  FTE  variation  was  noted  which  for  small 
segments  of  data  caused  FTE  to  exceed  the  1.0  nm  tolerance.  Second,  the  rea- 
son for  both  the  sinusoidal  characteristic  and  the  greater  than  1.0  nm  nuuinitude 
was  an  RNAV  guidance  discontinuity  which  was  common  to  both  analog  RNAV  systems 
tested.  Third,  larger  FTE  was  noted  as  a general  character!  tic  on  the  higher 
workload,  relatively  short  base  leg.  The  fact  that  most  bast  leg  data  is  pre- 
ceded by  a 90°  turn  from  downwind  and  followed  by  a 90°  turn  onto  final  coupled 
with  the  aircraft  control,  communications  workload  and  RNAV  jnda*e  requirements 
appeared  to  cause  the  larger  GDI  deflections.  Fourth,  the  repeatability  and 
precision  of  the  final  approach  FTE  was  verified  graphically.  Approach 
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sensitivity  of  >0.25  nm  per  dot  resulted  in  less  than  the  required  0.5  nm  FTE 
tolerance  even  on  the  minimum  capability  RNAV  system. 
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The  definition  of  steady  state  FTE  data  was  presented  in  Section  3.1.6 
This  discussion  was  provided  to  define  what  type  of  data  was  edited  prior  to 
statistical  aggregation  and  to  show  that  the  editing  had  no  detrimental  impact 
on  the  analysis  of  conclusions.  Table  3.10  showed  the  unedited  (worst  case) 

FTE  statistics  compared  to  the  steady  state  statistics  for  several  different 
statistical  aggregations  - terminal  area,  final  approach,  individual  STARs, 
individual  route  segments,  and  individual  subject  pilots.  No  significant  re- 
duction in  FTE  occured  in  any  of  these  categories  due  to  editing.  Figures 
3.6  and  3.7  were  histograms  which  graphically  demonstrated  that  steady  state 
data  simply  eliminates  outlier  data.  Both  steady  state  ana  worst  case  data 
were  normally  distributed  with  means  very  close  to  zero. 

The  final  section  (3.1.7)  summarized  the  available  data  on  the  impact  of 
cockpit  displays  on  flight  technical  error.  Three  factors  known  to  influence 
FTE  were  included  - display  sensitivity  or  scale  factor  (nm/dot),  display  type 
(linear  or  angular  deviation)  and  display  complexity  (GDI,  FISI,  SPI,  FD).  Al- 
though display  sensitivities  of  0.1,  0.25,  1.0  and  2.5  nm/dot  were  tested,  no 
differential  effect  on  FTE  was  noted  for  scale  factors  up  to  1 nm  per  dot. 
Similarly,  although  linear  and  angular  displays  were  both  tested  with  and  with- 
out integral  heading  presentation,  no  systematic  FTE  differences  appeared. 

Lack  of  data  to  establish  the  impact  of  complex  displays  on  FTE  precluded  a 
firm  conclusion  on  this  issue.  However,  no  significant  differences  in  FTE 
occurred  between  the  HSI  and  GDI  tested. 
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3.2  TURN  PERFORMANCE 

The  RNAV  Task  Force  projected  a requirement  for  turn  anticipation  based 
on  increased  traffic  demands  and  the  desired  efficient  utilization  of  airspace. 
The  problem  of  maintaining  adequate  lateral  separation  between  aircraft  on  par- 
allel routes  during  turns  was  recognized.  The  current  practice  of  requiring 
the  controller  to  insure  radar  separation  in  the  turn  was  judged  as  too  limit- 
ing on  RNAV  capabilities  and  not  consistent  with  the  desire  to  place  the  con- 
troller more  in  a monitor  role.  As  a part  of  the  system  design  concept, 
the  Task  Force  identified  problems  which  required  solutions  prior  to  full 
RNAV  implementation.  The  specific  turn  anticipation  problem  addressed  in  the 
Task  Force  document  was  one  of  maintaining  adequate  lateral  separation  during 
the  turn  between  two  aircraft  of  widely  different  airspeeds  when  the  slower 
aircraft  is  on  the  inside  of  the  turn.  The  associated  solution  was  to  determine 
the  procedural  or  regulatory  requirements  necessary  to  insure  the  proper  later- 
al separation.  Since  the  issuance  of  the  Task  Force  Report,  both  flight  tests 
and  cockpit  simulator  tests  have  been  performed  to  establish  the  turn  airspace 
utilization  for  aircraft  having  a wide  range  of  speed  capabilities.  The  data 
acquired  during  these  tests  includes  assessment  of  turn  performance  (FTE  and 
airspace  utilization)  without  any  type  of  anticipation,  with  procedural  antic- 
ipation and  with  an  automatic  anticipation  light.  Data  analysis  will  progress 
from  an  assessment  of  the  effects  of  turn  anticipation  technique  on  FTE  to  a 
comparative  assessment  of  the  turn  overshoot  and  undershoot  airspace  used  by 
the  various  RNAV  system  types  tested.  The  results  presented  will  quantify  both 
FTE  and  airspace  requirements  for  various  systems  installed  in  aircraft  typical 
of  user  applications.  The  range  of  speeds  represented  include  130  knots  to 
220  knots. 

This  section  will  address  turn  performance  in  the  following  manner: 

(1)  Relationship  between  FTE  and  two  types  of  turn  anticipation 

(2)  Evaluation  of  turn  overshoot  airspace  for  3 levels  of  RNAV  systems 

(3)  Evaluation  of  turn  overshoot  airspace  for  the  minimum  capability 

RNAV  system  using  two  distinct  turn  procedures 

(4)  Quantification  of  FTE  without  turn  anticipation 

The  data  supporting  item  (1)  will  be  derived  from  a cockpit  simulator  ex- 
periment (Appendix  A).  The  data  utilized  for  item  (2)  will  come  from  the  G-1/ 

Butler  flight  tests  [11]  as  well  as  two  additional  sources.  The  turn  perfor- 

mance of  a complex  airline  quality  RNAV  system  will  be  derived  from  the  NAFEC 
G-l/Collins  experiment.  The  turn  performance  of  a minimum  capability  RNAV 
system  will  come  from  the  Aero  Commander  500/King  evaluations  performed  at  Miami 
and  Denver.  The  King  experiment  from  Miami  will  also  provide  data  for  item  (3). 
Item  (4)  will  be  discussed  using  G-l/Butler  [11]  and  the  cockpit  simulator  data 
(Append! x A) . 

The  first  objective  of  this  section,  evaluating  the  relationship  of  FTE 
for  two  types  of  turn  anticipation  techniques,  was  a specific  element  of  the 
University  of  Illinois  cockpit  simulator  experimental  matrix.  This  program 
measured  FTE  differences  as  well  as  procedural  and  blunder  errors  for  both  pro- 
cedural and  automatic  turn  anticipation  techniques.  Thiv  data  will,  therefore, 
be  the  sole  source  used  for  analysis. 
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Evaluation  of  the  second  objective,  turn  overshoot  airspace,  requires 
availability  of  actual  aircraft  track.  This  translates  into  a tracking  radar 
requirement  for  flight  tests  and  x-y  plotter  data  for  actual  aircraft  location 
in  a cockpit  simulator  test.  The  data  from  the  King,  Butler  and  Collins  flight 
tests  all  had  radar  tracking  data  and  will  be  used  for  this  analysis.  The  Uni- 
versity of  Illinois  cockpit  simulator  essentially  defined  RNAV  indicated  pos- 
ition as  actual  GAT  2 position  due  to  the  calibration  procedures  used  and  the 
lack  of  sensor  noise  in  the  VOR  signal.  T' erefore,  this  data  is  not  applic- 
able to  an  analysis  of  turn  overshoot  airspace  requirements. 


Objective  number  three  can  only  be  addressed  using  the  King  KN  74  data, 
since  this  was  the  only  single  waypoint  system  in  the  overall  experimental  FTE 
matrix.  By  definition,  a single  waypoint  analog  system  without  functional  cap- 
abilities for  turn  anticipation,  parallel  offset,  or  "Direct  To"  maneuvers  meets 
the  requirement  of  the  minimum  system  classification. 


The  fourth  objective,  quantifying  FTE  without  turn  anticipation,  will  be 
evaluated  using  the  G-l/Butler  flight  test  results.  During  these  tests,  the 
pilot  was  not  allowed  to  anticipate  the  turn.  Unfortunately,  the  pilot  was  not 
given  any  instructions  on  how  to  minimize  cross  track  deviation  in  turns.  The 
pilot  was  given  the  Butler  pilot  guide  which  instructed  that  waypoint  sequencing 
for  the  next  route  segment  should  be  performed  just  prior  to  reaching  the  way- 
point  being  used  for  current  navigation.  As  a result  of  this  procedure,  over- 
shoots of  the  outbound  course  were  common  during  these  tests.  This  data  repre- 
sents the  worst  case  of  FTE  and  airspace  utilization  during  turns  as  far  as 
turn  overshoots  are  concerned. 


3.2.1  T h^  Effects  of  Turn  Anticipation  Technique  on  FTE 

Cockpit  simulator  tests  have  been  performed  at  the  University  of  Illinois 
using  a Singer-Link  GAT  2 simulator,  a Ratheon  704  digital  computer  and  an  ex- 
perimental RNAV  control  panel.  The  experiment  evaluated  the  relative  effects 
of  waypoint  storage,  course  offset,  turn  angle  and  turn  anticipation  techniques 
on  pilot  performance.  FTE  was  measured  in  3D  RNAV  departures,  enroute  flight, 
arrivals  and  approaches.  The  detailed  results  from  this  experiment  are  pre- 
sented in  Appendix  A.  This  subsection  will  briefly  summarize  the  character- 
istics of  the  cockpit  simulator  experiment  including  a description  of  the  route 
profiles,  an  experimental  matrix  of  the  variables  tested,  a detailed  descrip- 
tion 01  the  turn  anticipation  techniques  and  finally  a presentation  of  the  re- 
sults of  the  experiment  pertinent  to  the  effects  of  turn  anticipation  techniques 
on  the  magnitude  of  FTE. 

The  basic  RNAV  routes  flown  were  related  to  actual  terminal  area  arrival  and 
departure  procedures,  developed  for  the  JFK  terminal  area  a.  described  tn  Section 

2.1  of  the  introduction.  The  particular  circuitous  route  flown  exclusively  during 
the  University  of  Illinois  turn  anticipation  evaluation  was  designated  the  B-1 
route.  The  actual  SID  and  STAR  charts  and  the  approach  plate  used  by  the  subjects 
of  this  test  are  illustrated  in  Figures  3.11,  3.12  and  3.13  respectively.  These 
plates  were  developed  from  the  composite  FTE  experimental  routes  shown  in  Figure 
2.3  based  on  desired  flight  duration,  aircraft  speed,  desired  altitude,  a repre- 
sentative range  of  turn  angle  magnitudes  and  vertical  profiles.  Table  3.17  sum- 
marizes the  turn  magnitudes  and  directions  tested  using  the  RNAV  routes  shown  in 
Figures  3.11  to  3.13.  It  can  be  seen  that  the  magnitudes  vary  from  3'  to  97 
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ATLA^~  C CITY  TWO  RNAV  DEPARTURE 


I 


i 


Figure  3.13  University  of  Illinois  Cockpit  Simulator  Approach  Plate 


with  three  right  hand  and  five  left  hand  turns.  The  last  column  of  Table  3.17 
indicates  the  vertical  conditions  under  which  the  turns  were  executed.  However, 
pi lot-to-pi lot  variations  as  well  as  varying  the  offset  conditions,  produced 
some  variations  in  the  actual  vertical  track. 

The  basic  experimental  evaluation  for  the  turn  angles  specified  was  the  re- 
lationship between  turn  anticipation  technique  and  FTE.  The  experimental  matrix 
used  for  this  investigation  consisted  of  150  flights,  each  of  approximately  one 
hour  duration. 

A total  of  30  subject  pilots  was  used  with  a wide  variety  in  experience 
from  current  air  carrier  pilots  to  newly  instrument  rated  commerical  pilots. 

Both  RIIAV  experienced  and  RNAV  inexperienced  subjects  were  used.  Table  3.18 
illustrates  the  complete  breakdown  of  the  experimental  matrix  by  subject,  turn 
anticipation  techniques  and  by  other  experimental  variables. 
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Two  types  of  turn  anticipation  were  evaluated:  one  type  of  procedural 

turn  anticipation  which  requires  no  additional  cockpit  mechanization  and  one 
ty,'.:-  of  automatic  turn  anticipation.  The  automatic  turn  anticipation  consisted 
of  implementing  an  additional  cockpit  warning  or  alert  light  to  inform  the 
pilot  that  a turn  and  corresponding  waypoint  passage  was  imminent.  The  type 
of  alert  light  used  has  been  referred  to  as  a "smart"  light.  This  terminology 
results  from  the  fact  that  the  light  illuminates  as  a function  of  ground  speed 
and  turn  angle  magnitude,  thereby  providing  the  pilot  with  a signal  as  to  when 
a turn  should  be  initiated. 
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Table  3.18 


UNIVERSITY  OF  ILLINOIS  GAT  2/MINI  COMPUTER 
EXPERIMENTAL  DESIGN 


Fixed  Quantitites:  1. 

2. 

3. 

4. 


B1  routes  for  consistency  with  G-l/Collins  flight  tests 
Single  A/C  configuration  (approximately  200-220  knots  TAS) 
3D  RNAV  approaches  only 
No  wind 


Experiment  Matrix: 


■ TURN  ANTICIPATION 
1 TECHNIQUE 
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Procedural  Tu^n  AnticJj^tjpjT^ 

The  common  method  for  anticipating  turns  along  an  RNAV  route  is  to  moni- 
tor the  distance-to-waypoint  (DTW)  indication.  The  turn  is  then  initiated  at 
a distance  prior  to  the  waypoint  which  is  roughly  in  proportion  to  the  severity 
of  the  turn  (track  angle  change).  This  method  has  been  found  to  work  reason- 
ably well  during  RNAV  flight  checks.  For  all  practical  purposes,  a constant 
turn  anticipation  distance  results  for  a given  speed  class  of  aircraft.  How- 
ever, results  have  shown  that  turn  performance  using  a constant  turn  anticipa- 
tion distance  is  somewhat  unpredictable  due  to  the  inevitable  flight  technical 
error  which  generally  exists  when  the  anticipation  distance  is  reached.  Two 
possible  situations  are  illustrated  in  Figure  3.14,  both  with  a flight 
technical  error  of  0.5  miles.  As  is  obvious  from  the  figure,  cross  track 
flight  technical  error  couples  directly  into  resulting  available 
anticipation  distance.  The  effects  shown  in  Figure  3.14  explain  why  experience 
to  date  with  DTW  anticipation  has  shown  it  to  produce  unpredictable  results. 
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Fiouro  1.14  FTF  Fffccts  '-'hen  Leading  a Turn 

The  simulator  experimental  procedures  were  designed  to  overcome  the  turn 
overshoot  effects,  characteristic  of  constant  distance  anticipation.  A two-step 
anticipation  procedure  was  used.  The  object  of  this  procedure  was  to  separate 
the  OBS  course  input  function  from  the  actual  roll-in  to  the  turn.  The  first 
step  was  to  sequence  tracks  (change  OBS  setting)  always  at  the  same  DTW  reading 
(e.g.,  two  miles  for  the  150  knoc  speed  class),  while  holding  present  track  head- 
ing. The  turn  itself  was  initiated  based  on  information  ^rom  the  course  devia- 
tion indicator  (GDI),  not  DTW.  Once  track  angle  input  is  .complete , the  GDI  dis- 
plays cross  track  distance  with  respect  to  the  new  track,  and  it  is  proper  to 
initiate  the  turn  at  a GDI  distance  which  is  roughly  proportional  to  the  magni- 
tude of  the  track  angle  change.  Therefore,  this  procedure  overcomes  the  effects 
illustrated  in  Figure  3.14. 

Parallel  offset  operations  complicate  the  problem  of  procedural  turn 
ancitipation  to  a great  extent.  It  is  for  this  reason  that  the  University  of 
Illinois  experiment  included  parallel  offset  flying  as  an  element.  The  prob- 
lem is  not  so  much  one  of  finding  suitable  ways  for  procedurally  ,mt i ci i>at ing 
parallel  offset  turns  as  it  is  one  of  pilot  training,  proficiency  and  work- 
load, since  there  are  three  different  turn  procedures  (centerl ine, inside  and 
outside  effects)  each  with  the  potential  for  making  a mistake  and  over-.hoot ing 
the  track.  In  addition,  the  three  techniques  increase  the  potential  for 
confusion. 
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The  procedure  for  anticipating  turns  while  flying  a parallel  offset  route 
is  functionally  similar  to  those  discussed  in  the  preceding  paragraphs.  First, 
there  must  be  a provision  for  some  cue  that  the  track  should  be  sequenced  (OBS 
setting  changed).  Second,  track  heading  is  held  until  the  GDI  indication  is  ap- 
propriate for  initiating  the  turn  onto  the  new  track.  The  track  sequencing  cue 
is  different  for  the  three  cases  of  being  on  the  outside  of  the  turn,  or  the  in- 
side of  the  turn,  or  on  the  parent  route.  This  is  where  the  potential  for  con- 
fusion arises.  The  cues  used  in  the  University  of  Illinois  experiment  were  as 
follows : 

1.  On  a parallel  inside  offset,  anticipate  the  turn  by  an  amount 
equal  to  the  magnitude  of  the  offset  plus  two  miles.  "Anticipate" 
means  set  the  following  course.  The  actual  turn  should  be  ini- 
tiated when  displayed  course  information  indicates  a need  for  the 
turn . 

2.  On  the  centerline,  anticipate  the  turn  by  twc  miles. 

3.  On  a parallel  outside  offset,  anticipate  the  turn  using  the 
"To-From"  indicator.  When  this  display  indicates  "From", 
change  to  the  outbound  or  next  course. 

The  alternate  turn  anticipation  technique  was  provided  by  an  automatic  turn 
anticipation  light  as  previously  described.  Pilots  using  this  technique  were 
instructed  to  initiate  the  roll-in  to  a standard  rate  turn  very  soon  after  re- 
ceiving the  visual  turn  anticipation  indication. 

Table  3.19  University  of  Illinois  Cockpit  Simulator  FTE  Statistics 

During  Turns 


Waypoi nt 

Route 

Procedural  Turn 

1 Turn  Anticipation  | 

Storage 

Anticipation 

"Smart"  Light 

( ' 2 Si gma ) 

(.*2  Sigma) 

1 

Parent 

0.84 

0.52 

' 

Offset 

1.35 

0.82 

Combined 

1.24 

, 0.77 

1 .....  . ^ 

2 

Parent 

0.62 

0.42 

Offset 

0.74 

0.76 

Combined 

0.61 

0.77 

3 

Parent 

0.56 

0.41 

Offset 

1.22 

0.67 

Combi ned 

1.11 

■ 0.57 

Total 

Parent 

0.68 

0.47 

Aggregate 

Offset 

1.13 

0.66 

(1,2.3 

combined) 

Combined 

1.04 

0.72 
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Cross  flight  statistics  for  FTE  during  turns  with  the  two  anticipation 
techniques  are  presented  in  Table  3.19  both  for  parent  route  (centerline  track- 
ing) and  parallel  offset  operations.  This  tabular  comparison  shows  two  impor- 
tant facts.  First,  procedural  turn  anticipation  resulted  in  FTE  significantly 
less  than  the  current  required  2.0  nm  level  for  all  routes  tested  and  signifi- 
cantly less  than  the  reduced  1.0  nm  level  for  all  parent  route  data.  Second, 
for  all  waypoint  storage  categories  tested  and  for  both  parent  route  tracking 
as  well  as  parallel  offset  tracking,  the  use  of  an  automatic  turn  anticipation 
warning  light  or  cue  significantly  reduced  the  already  small  FTE  measured  with 
procedural  turn  anticipation.  The  data  in  general  showed  a slight  right  of 
course  bias  for  both  turn  anticipation  techniques  tested.  In  fact,  the  statis- 
tical aggregation  performed  showed  that  the  central  tendency  or  mean  bias  error 
was  to  the  right  of  course  and  varied  from  approximately  0.05  nm  to  0.185  nm. 
The  magnitude  and  direction  of  this  bias  have  been  measured  in  previous  Univer- 
sity of  Illinois  experiments. 


Close  examination  of  the  FTE  values  listed  in  Table  3.19  shows  some  very 
interesting  and  significant  trends.  First  of  all,  the  FTE  benefits  due  to  usage 
of  the  turn  anticipation  light  (TAL)  over  procedural  turn  anticipation  (PTA)  are 
quite  significant.  Using  a percent  deviation  calculation  of  the  form: 


°L  Improvement  = 


(FTE) 

PTA  - 

TfteT'  ■ 

PTA 


(FTE) 


TAL 


X 


100 


shows  that  FTE  using  the  TAL  technique  was  31%  lower  than  using  the  PTA  techni- 
que. Secondly,  comparing  parent  route  to  offset  route,  FTE  improvement  shows 
that  an  even  larger  benefit  is  gained  by  using  the  TAL.  Specifically,  per  cent 
improvement  for  the  light  was  42%  when  compared  with  procedural  turn  anticipa- 
tion. This  trend  verifies  the  logical  assumption  that  the  more  complex  proce- 
dures involved  with  flying  an  offset  route  are  complicated  even  further  by  the 
workload  involved  with  a procedural  turn  anticipation  technique.  As  a matter  of 
fact,  the  parent  route  FTE  statistics  for  all  levels  of  waypoint  storage  were 
significantly  lower  than  the  offset  FTE  statistics.  In  addition,  the  parent 
route  FTE  statistics,  the  offset  route  FTE  statistics  and  the  combined  statistics 
were  less  than  1.0  nm  for  all  levels  of  waypoint  storage  when  the  turn  anticipa- 
tion 1 ight  was  used. 


In  contrast,  the  procedural  turn  anticipation  technique  showed  parent  route 
FTE  less  than  the  1.0  nm  level  but  offset  route  FTE  statistics  greater  than  1.0 
nm  for  all  but  the  2 waypoint  case.  PTA  data  showed  increases  in  offset  FTE 
varying  from  19%  for  the  2 waypoint  system  to  61°'  for  1 waypoint  and  118  for  3 
waypoint  systems  when  compared  to  parent  route  FTE. 

In  summary,  the  cockpit  simulator  data  showed  that  using  procedural  turn 
anticipation  techniques  reduces  turn  overshoots  to  less  than  2.0  nm.  There- 
fore, procedural  turn  anticipation  eliminates  the  requirement  for  additional 
turn  overshoot  airspace  if  the  current  -2.0  nm  route  width  specification  is  re- 
tained. Consequently,  some  type  of  procedural  turn  anticipation  should  be  con- 
sidered as  a minimum  requirement  for  efficient  RNAV  operations.  In  addition, 
the  cockpit  simulator  data  showed  that  the  turn  anticipation  light  resulted  in 
appreciable  reduction  in  already  small  FTE  statistics  over  the  procedural  turn 
anticipation  technique  tested.  This  result  was  verified  for  both  parent 
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route  and  offset  flying.  In  addition,  the  automatic  turn  anticipation  light 
resulted  in  "In-Turn"  FTE  less  than  il.O  nni  for  both  parent  and  offset  route 
cases.  The  automatic  turn  anticipation  light  should,  therefore,  be  considered 
a valuable  improvement  in  any  integrated  RNAV  system  but  not  necessarily  a 
minimum  requirement. 

3.2.2  Airspace  Utilization  During  Turns 

This  subsection  addresses  turn  performance  using  area  navigation  from  a 
track  accuracy  viewpoint  rather  than  solely  an  FTE  viewpoint.  Aii.raft  track- 
ing accuracies  are  derived  from  actual  aircraft  position  data  as  easured  by 
tracking  radar.  Results  are  presented  from  two  extreme  levels  >f  RNAV  system 
capabilities.  The  sophisticated  airline  quality  systems  are  repiuaented  by 
the  Collins  ANS-70A  flight  test  results.  This  system  has  automatic  turn  anti- 
cipation which  is  a function  of  aircraft  speed  and  the  magnitude  of  track  an- 
gle change.  Track  sequencing  is  automatic  upon  waypoint  passage  (i.e.,  cross- 
ing the  bisector  of  the  turn  angle).  The  Collins  system  is  also  bank  angle 
limited  in  turns.  The  general  aviation  type  area  navigation  systems  are 
evaluated  for  turn  tracking  accuracy  using  the  single  waypoint  King  KIJ  74  flight 
test  results  from  the  Miami  terminal  area  evaluation.  This  system  has  no 
provision  for  automatic  turn  anticipation.  Track  sequencing  is  accomplished 
manually  using  a card  type  omni  bearing  selector  (DBS).  Navigation  guidance 
(left/right  course  deviation)  is  provided  in  both  flyitig  "To"  and  "From"  an 
RNAV  waypoint  by  a KNI520  course  deviation  indicator  (CDI). 

Examination  of  the  results  of  the  Collins  turn  performance  will  illustrate 
the  type  of  accuracy  to  be  expected  of  an  airline  quality  system.  The  perfor- 
mance of  this  system  in  both  the  manual  and  autopilot  modes  was  more  than  ade- 
quate. The  detailed  data  is  presented,  rather  than  simply  a tabular  summary, 
to  illustrate  this  fact  and  to  reinforce  the  small  magnitudes  of  turn  overshoot 
and  undershoot  discussed. 

The  flight  test  route  used  in  the  NAFEC  evaluation  of  the  Collins  RNAV  sys- 
tem was  derived  from  the  same  terminal  area  design  and  the  same  duration  of 
flight,  altitude,  airspeed  and  workload  considerations  as  stated  in  Section 
3.2.1  for  the  University  of  Illinois  cockpit  simulator  experiment.  The  route 
used  was  designated  B-2  and  illustrated  graphically  on  Figure  2.3  of  the  intro- 
duction. A sketch  of  the  route  is  repeated  in  Figure  3.15  for  reference  purposes 
The  turn  angle  directions  and  magnitudes  used  on  this  route  are  presented  on 
Table  3.20  along  with  the  vertical  profile  chara.teristic  at  each  turn  (waypoint) 

The  accurate  and  repeatable  turn  performance  measured  by  the  tracking  radar 
is  presented  in  Figures  3.16  to  3.21  for  the  waypoints  indicated  in  Table  3.20. 

No  data  was  available  for  waypoints  B and  R due  to  variations  in  departure  run- 
way and  pilot  procedures  used  to  acquire  the  desired  RNAV  track.  Since  all 
flights  had  acquired  the  desired  track  prior  to  SIERRA  waypoint,  the  turn  analy- 
sis began  at  this  waypoint. 

The  turn  performance  in  general  for  left  turns  from  13  to  83  and  right 
turns  from  41"  to  112"  showed  no  significant  difference  in  RNAV  tracking  accu- 
acy.  In  fact,  the  turns  f coin  1 3 ’ to  52^  showed  symmetrical  data  scatter  about 
the  desired  track  at  waypoi nt"  passage  as* well  as  preceding  and  following  the 
required  turn.  The  symmetrical  characteristics  of  this  data  suggests  a require- 
ment to  analyze  turn  undershoot  as  well  as  turn  overshoot  airspace  regui retmuifs . 
Maximum  data  scatter  flight  to  flight  for  the  small  angle  turns  at  the  turn 
angle  bisector  was  0.35  nm  for  both  manual  and  autopilot  flights  (Figure  3..;0). 

In  the  shallow  angle  turns,  the  minimum  scatter  about  the  desired  course  center- 
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Figure  3.19  6-1/Collins  Flight  Test,  41°  Right  Hand  Turn,  DME/DME  Mode 
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Figure  3.20  G-l/Collins  Flight  Test,  52°  Right  and  83°  Left  Hand  Turns,  DME/DME  Mode 
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line  occured  during  the  22°  left  hand  turn  at  GOLF  waypoint  on  Figure  3.21*. 

This  was  *0.10  nm  and  was  measured  during  autopilot  flights.  During  manual 
flights  the  minimum  data  scatter  also  occurred  at  this  waypoint.  The  value 
was  *-0.15  111,1.  A high  degree  of  pilot  attention  is  probable  at  this  waypoint  due 
to  the  proximity  of  the  runway  and  the  desire  to  track  accurately  on  the  base 
leg  prior  to  intercepting  final  approach.  These  factors  probably  account  for 
the  highly  accurate  manual  data  on  the  22°  turn  which  was  better  than  the  accuracy 
exhibited  on  the  shallower  13°  left  hand  turn  during  departure  at  SIERRA  way- 
point  (Figure  3.16). 

The  turn  performance  recorded  for  the  larger  magnitude  turns  showed  approx- 
imately the  same  anount  of  data  scatter  (almost  none)  as  the  shallow  turns;  how- 
ever, the  tendency  to  overshoot  and  undershoot  increased  significantly  for  the 
76°  right  hand  turn  at  WHISKEY  waypoint.  The  manual  data  shows  both  undershoot 
and  overshoot  tendencies  while  the  autopilot  was  more  consistent  in  anticipating 
and  undershooting  the  turn.  However,  even  for  this  76°  turn,  the  maximum  spread 
flight  to  flight  was  only  ±0.35  nm  in  the  manual  mode.  In  addition,  the  maximum 
manual  overshoot  at  WHISKEY  waypoint  was  only  0.5  nm.  The  maximum  autopilot 
undershoot  was  approximately  1.0  nm  at  this  waypoint.  It  should  be  noted  that 
although  the  undershoot  or  corner  cutting  tendency  in  the  autopilot  mode  resulted 
in  the  largest  data  scatter  at  a turn,  all  turn  data  was  within  the  ±1.5  nm  route 
width. 

The  83°  left  turn  at  HOTEL  waypoint  (Figure  3.20)  and  the  80°  right  turn  at 
BALTIC  (BB)  waypoint  (Figure  3.21)  showed  interesting  results.  The  80°  data  at 
BALTIC  showed  both  overshoot  and  undershoot  characteristics  for  manual  and 
autopilot  tracking  while  the  83°  data  at  HOTEL  waypoint  showed  only  undershooting 
characteristics  for  both  modes  of  flight.  Both  of  these  waypoints  were  located 
on  the  final  approach  course  intercept  with  the  base  leg.  Navigation  was  in 
the  DME/DME  mode  for  both  data  sets.  The  reasons  for'the  small  overshoots  in 
both  manual  (0.6  nm)  and  automatic  (0.7  nm)  on  the  turn  at  BALTIC  were  related 
to  the  aircraft  speed  reduction  during  this  phase  of  flight  and  the  fact  that 
the  air  data  computer  in  use  had  a lower  limit  of  150  knots.  When  the  aircraft 
speed  dropped  below  150  knots,  the  RNAV  computer  assumed  no  air  data  complementa- 
tion was  available  and  degraded  to  a time  constant  filter  on  the  radio  data  in- 
stead of  a modified  Kalman  filter.  This  resulted  in  the  slight  overshoots.  The 
approach  data  substantiated  this  rationale  by  exhibiting  a mean  error  on  the 
approach  segments  which  was  gradually  reduced  as  a function  of  time. 

As  would  be  expected,  the  worst  turn  performance  occurred  in  the  execution 
of  the  112°  right  hand  turn  for  both  autopilot  and  manual  flights  (Figure  3.18). 
Both  overshoots  and  undershoots  were  measured  in  autopilot  mode  while  every  man- 
ual flight  showed  an  overshooting  tendency  (minimum  of  0.4  nm  and  maximum  2.0  nm). 
Maximum  overshoot  measured  in  autopilot  mode  was  less  than  0.4  nm.  The  spread 
in  the  data  is  also  different  for  manual  and  autopilot  data  during  this  large 
magnitude  turn.  Manual  data  showed  that  all  pilots  anticipated  the  turn  at  from 
1.3  to  0.6  nm  prior  to  waypoint  passage  (DTW).  Nevertheless,  all  manual  1 lights 
overshot  the  outbound  course  as  previously  stated.  Data  scatter  at  the  passage 
of  the  angle  bisector  was  negligible  (less  than  0.3  nm)  for  all  the  manual  flights. 

*Note  that  both  Figure  3.20  and  3.21  include  a few  aircraft  tracks  signi ficantly 
different  than  the  others.  These  were  desired  profiles  on  particular  flights 
testing  the  delay  fan  concept  and  will  be  treated  separately  in  Section  3.4. 
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i;  The  autopilot  flights  similarly  anticipated  waypoint  passage  and  initiated  the 

turn  anywhere  from  3.5  nm  to  1.0  nm  prior  to  waypoint  passage  (DTW).  Data  scat- 
: ter  on  the  inside  of  the  turn  was  1.3  nm  at  the  angle  bisector.  That' is,  the 

closest  any  flight  came  to  the  waypoint  was  0.7  nm  along  the  bisector  and  the 
I farthest  away  was  2.0  nm  along  the  bisector. 

j Two  facts  are  pertinent  from  the  112°  turn  data.  First,  2.0  nm  overshoot- 

ing  must  be  accommodated  to  encompass  manual  and  autopilot  turn  performance 
! limits.  Second,  the  autopilot  used  a significantly  larger  turn  anticipation 

|i  lead  in  (up  to  3.5  nm)  when  compared  to  the  manual  data  (maximum  lead  in  occurred 

M at  1.3  nm  DTW).  Since  the  ANS-70A  steering  command  was  based  on  aircraft  speed 

and  turn  angle  magnitude  and  since  the  command  was  supplied  to  both  the  auto- 
pilot and  the  flight  director  simultaneously,  it  was  concluded  that  the  auto- 
pilot response  was  much  faster  than  the  response  of  the  pilot  to  the  flight 
director.  This  faster  autopilot  response  and  longer  lead  into  the  112°  turn 
produced  milder  turn  overshoots  on  the  outbound  route  segment  (less  than  0.4  nm 
' autopilot  compared  to  a maximum  of  2.0  nm  in  the  manual  mode).  Table  3.21 

summarizes  the  results  detailed  in  the  preceding  discussion. 

r In  order  to  allow  a direct  comparison  of  King  and  Collins  results.  Table 

3.22  was  created  in  a format  analogous  to  Table  3.21. 

Table  3.21  G-l/Collins  Turn  Performance  Accuracy 


1 

Turn  Angle 
Magnitude 

Data  Bandwidth  at 
Angle  Bisector 

(Degrees) 

1 

Manual 

(nm) 

Autopilot 

(nm) 

Tracking  Characteristic 

1 

1 

i 13 

0.6 

0.5 

On  Track 

1 22 

0.3 

On  Track 

41 

0.7 

0.7 

On  Track 

52 

0.5 

0.4 

On  Track 

76 

0.7 

0.4 

Overshoot  & undershoot  manual , 
always  undershoot  autopilot. 
1.0  nm 

80 

0.8 

0.4 

Undershoot  & overshoot  manual 
& autopilot 

83 

0.4 

0.3 

No  overshoot  only  undershoot 
manual  & autopilot 

1.8 

Undershoot  & overshoot  manual 
& autopilot 
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Table  3.22 


A.C.  500/King  Turn  Performance  Accuracy 


Turn  Angle 
Magnitude 

Data  Bandwidth  at 
Angle  Bisector 

Tracking  Characteristics  ! 

1 

i 

t 

(Degrees ) 

Procedural 

(nm) 

Without 

(nm) 

32° 

0.9 

0.5 

Consistent  undershoots.  No  1 

significant  overshoot 

r 

o 

LO 

1.3 

0.4 

Overshoot  & undershoot  procedural , 
only  overshoot  without  TA 

59° 

0.8 

0.8 

Overshoot  & undershoot  both 
techniques 

89° 

0.8 

0.9 

No  overshoots  with  procedural. 
All  overshoots  without  TA. 

91° 

0.6 

0.8 

1 

Maximum  overshoot  of  .15  nm 
procedural.  All  overshoots  with- 
out TA.  Maximum  overshoot  of 
1.3  nm. 

3.2.3  Procedural  vs.  Turns  Without  Anticipation 

The  Miami  terminal  area  evaluation  of  the  single  waypoint  King  RNAV  system 
was  used  to  quantify  turn  accuracy  with  a minimum  capability  RNAV  system.  Two 
terminal  area  arrival  routes  were  evaluated  during  these  tests  and  these  are 
shown  schematically  in  Figures  3.22  and  3.23  along  with  the  scaled  test  results 
obtained  from  the  ARTS  III  radar  tracking  data.  The  NEW  RIVER  ONE  arrival  was 
an  RNAV  STAR  from  the  northwest  which  terminated  with  an  approach  to  runway  nine 
left.  This  STAR  consisted  of  two  left  turns  of  32  and  59  degrees  at  FROG  and 
COOPER  waypoints  respectively.  The  PIKE  ONE  arrival  was  an  RNAV  STAR  from  the 
northeast  which  also  terminated  in  an  approach  to  runway  nine  left.  This  STAR 
contained  three  turns;  54  degrees  to  the  right  at  BAKER  waypoint,  89  degrees  to 
the  left  at  FROG  waypoint  and  91  degrees  to  the  left  at  KROME  waypoint.  The 
commingling  of  the  two  arrival  routes  which  commenced  at  FROG  waypoint  combined 
with  the  normal  traffic  density  at  Miami  International  provided  an  excellent 
environment  for  evaluation  of  minimum  RNAV  system  performance  in  an  operational 
environment. 

The  King/Miami  flight  test  results  are  illustrated  in  Figures  3.22  and  3.23 
for  comparison  with  Collins  turn  performance.  These  results  can  also  be  used  to 
evaluate  procedural  turn  anticipation  (left  side  of  the  figures)  against  turn  per- 
formance without  anticipation  (right  side  of  the  figures).  In  general,  the  two 
turns  illustrated  in  Figure  3.22  for  the  NEW  RIVER  arrival  (32°  and  59°)  as  well 
as  the  54°  turn  on  the  PIKE  arrival  (Figure  3.23)  show  the  expected  data  scatter 
on  both  the  undershoot  and  overshoot  sides  of  the  outbound  track  for  the  proce- 
dural turn  anticipation  data.  The  data  for  the  89°  and  910  turns  at  FROG  and 
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Figure  3.22  A. C. 500/King  MIAMI  Flight  Test  NEW  RIVER  ONE 

Arrival  Turn  Performance 


**1.  V *N  r\i*N 


Figure  3.23  A. C. 500/King  MIAMI  Flight  Test  PIKE  ONE 
Arrival  Turn  Performance 


KROME  shows  a marked  tendency  to  undershoot  with  very  minor  (less  than  0.2  nm) 
overshoots  resulting  on  the  outbound  tracks. 

In  contrast,  the  turn  accuracy  traces  for  the  data  without  turn  anticipa- 
tion show  a marked  tendency  to  overshoot  for  all  turn  magnitudes  other  than 
32°  (FROG  waypoint,  Figure  3.22).  Maximum  turn  overshoot  varied  from  0.7  nm 
on  the  59°  turn  at  COOPER  waypoint  (Figure  3.22)  to  1.3  nm  following  the  91° 
left  turn  at  KROME  waypoint  (Figure  3.23).  These  overshoots  were  directly 
caused  by  the  subject  pilots  waiting  until  indication  of  waypoint  passage  ("To/ 
From"  flag)  prior  to  initiating  a standard  rate  turn. 

As  a means  of  summarizing  the  results  of  RNAV  turn  accuracy  with  procedural 
turn  anticipation  and  without  turn  anticipation.  Figure  3.24  was  plotted.  This 
figure  clearly  shows  that  with  procedural  anticipation,  the  overshoots  and 
undershoots  are  evenly  scattered  about  0 nm  with  9 data  points  below  and  8 data 
points  above  the  0 reference  line.  In  sharp  contrast,  the  turn  overshoot  data 
without  turn  anticipation  displays  a well  defined  linear  relationship  with  in- 
creasing turn  angle  magnitude.  The  linear  curve  fit  through  this  data  shows 
that  once  a turn  angle  greater  than  15°  is  attempted,  turn  overshoots  can  be 
an  expected  occurrence  if  no  turn  anticipation  technique  is  employed.  This  is 
compatibTe  with  current  FAA  procedures  for  allowing  additional  turn  overshoot 
airspace  for  turn  angles  greater  than  15°  (Flandbook  7110.18  [7]). 

Comparison  of  King  and  Collins  data  from  the  tables  and  figures  presented 
indicates  the  following  relative  performance: 

vs  Autopilot 

• Essentially  the  same  airspace  is  required  both  in  manual  and  auto- 
pilot mode  for  turns  using  the  automatic  turn  anticipation  technique 
provided  by  the  Collins  system. 

• Collins  data  showed  very  minor  scattering  and  was  located  essentially 
on  track  until  turn  magnitudes  exceeded  52°. 

• Although  tracking  through  turns  was  acceptable  in  both  manual  and 
autopilot  modes,  turn  undershoots  were  observed  using  automatic  turn 
anticipation. 

Procedural  vs  No  Procedural 

• Manual  flight  with  the  King  system  display  consistent  overshooting 
and  undershooting  characteristics  even  for  turns  at  shallow  magnitudes 
(32°  and  54°) 

• Overshooting  turns  in  excess  of  1.0  nm  occurred  at  both  89°  and  91° 
when  no  procedural  turn  anticipation  was  used. 

• Although  procedural  anticipation  reduced  turn  overshoots  for  turns 
from  32”-91°,  consistent  turn  undershoots  resulted  which  leads  to  a 
turn  undershoot  airspace  requirement. 


Airspace  Comparison 


t The  magnitude  of  the  data  bandwidth  or  scatter  was  in  general  2 to  3 
times  greater  for  the  King  system  compared  to  the  Collins  data  (.4  to 
1.3  King  compared  to  0.2  to  0.7  Collins) 

• The  systems  tested  did  not  demonstrate  a need  for  additional  turn  over- 
shoot or  undershoot  airspace  if  the  current  ±2.0  nm  route  width  specifi- 
cation is  retained. 

3.2.4  Quantification  of  FTE  Without  Turn  Anticipation 

Before  initiating  the  detailed  presentation  of  the  NAFEC  Butler  flight  test 
data  for  FTE  during  turns  without  any  type  of  anticipation,  it  is  pertinent  to 
review  the  Butler  FTE  data  in  general.  Referring  to  Table  3.3,  Section  3.1.2, 
it  can  be  seen  that  two-sigma  steady  state  FTE  was  0.68  nm  for  the  45  flights 
aggregated  in  terminal  area  operations.  This  magnitude  compared  favorably  with 
the  data  from  the  37  flights  of  the  King  system  at  Denver  and  Miami  and  also 
with  the  data  from  the  University  of  Illinois  tests  from  62  flights  of  the  same 
RNAV  system.  It  can  therefore  be  assumed  that  the  Butler  FTE  data  during  turns 
which  will  be  presented  is  representative  of  the  level  of  performance  to  be  ex- 
pected from  other  analog  systems  of  the  dual  and  single  waypoint  types.  There 
are  several  items  that  should  be  made  clear  concerning  the  methods  employed  dur- 
ing execution  of  turns  in  the  Butler  experiment  and  the  data  resulting  from 
those  methods.  First,  and  certainly  the  most  critical  of  the  methods,  is  the 
procedure  used  in  performing  turns.  In  this  experiment,  the  pilot  was  allowed 
no  anticipation  of  the  turn,  nor  was  he  given  instructions  as  to  how  to  minimize 
cross  track  error  in  turns.  The  pilot  simply  studied  the  Butler  RNAV  Pilot 
Guide  which  supplied  information  concerning  the  basic  use  of  the  RNAV  system. 

He  was  then  expected  to  fly  the  RNAV  pattern  to  the  best  of  his  ability.  That 
guide  instructed  the  pilot  to  dial  in  the  appropriate  information  for  the  next 
waypoint  just  prior  to  reaching  the  waypoint  to  which  he  was  navigating.  As  a 
result,  overshoots  of  the  following  leg  of  the  flight  path  were  common  in  this 
test. 


A second  procedure  and  related  equipment  characteristic  that  may  have  had 
an  impact  on  the  FTE  data  in  turns  was  the  waypoint  sequencing  procedure.  Be- 
cause of  the  turn  procedure  just  described,  waypoint  sequencing  was  done  con- 
sistently at  the  waypoint,  or  in  some  cases,  after  waypoint  passage.  This  pro- 
cedure sometimes  included  flying  "FROM"  one  waypoint  prior  to  flying  "TO"  the 
next  waypoint.  In  both  cases,  the  pilot  was  required  to  reset  his  track  to  the 
next  waypoint  on  the  Symbolic  Pictorial  Indicator  (SPI).  This  particular 
switching  operation  introduced  an  immediate  discontinuity  in  the  course  devia- 
tion output,  both  in  polarity  and  magnitude.  The  polarity  discontinuity  was 
caused  by  the  along  track  error  entering  into  the  cross  track  computations. 

These  shifts  in  information  to  the  pilot  may  have  had  a substantial  impact  upon 
his  tracking  abilities  around  turns  and  the  data  should  be  viewed  with  these 
considerations  in  mind.  It  was  felt,  however,  that  these  procedures  and  the 
observed  shifts  in  displayed  information  were  typical  of  a two  waypoint,  analog 
RNAV  system,  and  the  FTE  data  would  be  nominally  representative.  The  sequencing 
procedure  to  the  next  waypoint  and  the  resultant  "TO"  mode  brought  about  simi- 
lar shifts  in  information  to  the  pilot  and  elongated  the  period  of  uncertainty 
in  his  commanded  position.  When  the  information  on  the  pilot's  SPI  would  finally 
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stabilize,  normal  flight  resumed.  This  turning  period  and  its  related  anomalies 
are  an  important  subset  to  be  considered  in  the  overall  FTE  evaluation,  and  their 
presence  will  be  evident  throughout  the  following  discussions. 


Although  the  turns  tested  in  the  Butler  experiment  do  not  represent  a cross- 
section  of  all  possible  RNAV  turning  conditions,  the  data  gathered  does  provide 
meaningful  and  pertinent  information  regarding  FTE  performance  in  turns.  Figure 
3.25  shows  the  horizontal  profile  used  in  the  G-l/Butler  flight  test.  Only  three 
of  the  four  turns  provided  data  for  evaluation  the  fourth  being  the  start  and 
end  point  of  the  circuit.  The  three  turns  for  waypoints  1,  4 and  5 (Figure  3.25), 
consisted  of  a fifty  degree  turn  to  the  right  after  a simulated  departure 
out  of  NAFEC,  a one  hundred  degree  right  turn  after  a six  degree  descent  at  Way- 
point  4,  and  a seventy  degree  turn  onto  a pseudo-final  approach  course  at  Waypoint 
5.  Each  turn  was  evaluated  from  a point  2.5  nautical  miles  before  the  waypoint 
to  a point  3.0  r.iutical  miles  after  it.  This  procedure  did  cause  some  interaction 
of  data  in  turns  four  and  five;  however,  the  FTE  characteristic  magnitudes  in 
this  set  of  turns  is  applicable  to  a high  workload  environment  brought  about  by 
compact  maneuvering  and  continuous  data  updating.  This  environment  is  typical  of 
the  base  leg  operations  on  RNAV  STARs. 

Mean  cross  track  errors  and  2-standard  deviation  error  values  were  computed 
for  each  turn  intervals  mentioned  above,  for  each  of  the  VORTAC  stations 

used  du  light,  and  for  the  combined  data  from  both  VORTACs.  Table  3.23 

lists  Us  and  specifies  turn  magnitudes.  To  assist  in  the  understand- 
ing 0 -alts  of  Table  3.23,  Figures  3,27  through  3.30  display  the  curves 

deriv  . measured  needle  deflection  of  the  SPI  during  execution  of  these 
turns.  The  dotted  lines  represent  waypoint  sequencing  points  during  which  changes 
were  made  to  fly  "TO"  the  next  waypoint,  or  the  SPI  was  changed  to  fly  "FROM" 
the  waypoint  then  in  use.  Needle  movements  during  this  period  were  substantial 
in  most  cases.  Times  required  for  switching  varied  from  a few  seconds  at  Way- 
point  5 to  about  one  minute  at  Waypoint  4.  The  turns  at  Waypoint  1 averaged 
about  ten  seconds  sequencing  time.  The  impact  of  up  to  fifteen  seconds  of  way- 
point  sequencing  time  at  a turn  (the  equivalent  of  approximately  0.5  nautical 
miles  along  track  distance)  upon  the  flight  technical  error  in  the  shallower 
turns  of  this  test  was  minimal.  However,  the  one  minute  period  without  data  dur- 
ing the  one  hundred  degree  turn  at  Waypoint  4 had  a severe  impact  upon  FTE  at 
that  point.  The  pilot,  while  setting  in  the  appropriate  RNAV  data,  would  main- 
tain the  heading  of  the  "TO"  waypoint  route  segment,  and  as  the  "FROM"  RNAV  guid- 
ance was  initiated,  the  pilot  would  find  he  had  overflown  the  outbound  segment 
by  up  to  3 nautical  miles.  Figures  3.29  and  3.30  illustrate  this  point  graph- 
ically, and  Table  3.23  reflects  this  tendency  in  its  results.  The  setting-in  of 
waypoint  data  at  the  waypoint,  as  would  be  expected,  can  have  a very  detrimental 
effect  upon  precise  area  navigation  in  large  magnitude  turns. 


Table  3.23  G-l/Butler  FTE  Data  During  Turns 


Turn  Point 

Description 

Mean  and  Two  Sigma 

FTE  (nm) 

Degrees 

Sea  Isle 

Millville 

Combined 

Waypoint 

Direction 

Mean  2-a 

Mean 

2-0 

Mean 

2-0 

1 

500  right 

0.35L  1.15 

0.06R 

1.57 

0.09L 

1.48 

4 

100°  RIGHT 

0.49L  1.87 

0.46L 

1.17 

0.47L 

1.51 

5 

70°  RIGHT 

0.28L  1.42 

0.02L 

0.74 

0.14L 

1.18 

FTE  DATA  RADAR  TRACKS 


FIGURE  3.27  FTE  DATA  DURING  50^  RIGHT  HAND 
TURN  USING  SEA  ISLE  VORTAC 


FIGURE  3.28  FTE  DATA  DURING  50°  RIGHT  HAND 
TURN  USING  MILLVILLE  VORTAC 


3-70 


Addressing  the  data  obtained  in  the  fifty  degree  right  turn  at  Waypoint  1, 
particularly  that  in  Table  3.23  and  Figure  3.27,  it  is  clear  that  in  this  turn 
a similar  amount  of  airspace  was  used  by  the  pilot  in  both  the  Millville  and  Sea 
Isle  flights  although  the  Millville  data  indicated  a much  more  significant  FTE 
bias  to  the  left  of  course.  The  combined  data  in  this  turn,  Table  3.23,  indi- 
cates a tendency  by  the  pilot  to  favor  the  left  of  his  commanded  path  by  approx- 
imately 1.5  nautical  miles.  In  the  second  turn  encountered  on  the  test  route, 
the  one  hundred  degree  right  turn,  the  pilot  flew  more  precisely  while  using  the 
Millville  VORTAC  for  navigation.  This  is  apparent  in  Table  3.23  when  the  2- 
sigma  values  in  the  Sea  Isle  and  Millville  columns  are  compared.  The  mean  error 
values  while  performing  this  turn  were  similar  for  both  data  sets  and  were  in- 
fluenced by  the  waypoint  sequencing  effect.  The  combined  VORTAC  data  set,  as  in 
turn  number  one,  yielded  a 2-sigma  error  value  of  approximately  1.5  nautical 
miles.  The  mean  error  value  indicated  a tendency  by  the  pilot  to  be  left  of 
course  by  about  0.5  nautical  miles,  a substantial  amount.  The  influence  ex- 
erted upon  the  FTE  error  envelope  by  the  mean  can  be  seen  in  Figure  3.31  for 
the  one  hundred  degree  turn  as  well  as  for  the  other  two  turns. 


3.0  -j 

n MEAN  ERROR 

□ SEA  ISLE  VORTAC 
2 -SIGMA  VALUES 

nrTTl  MILLVILLE  VORTAC 
2-SIGfAA  VALUES 


.S0°  TURN/I  I00“  TURH'-I  70°TtlRN/5 


TURIsl  ANGLE./V.'AYPOINT 

Figure  3.31  Bar  Plot  of  In-Turn  Flight  Technical  Cross  Track  Error 
With  the  Mean  and  2-Sigma  Combined;  By  Turn 
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The  third  turn  in  this  experiment,  the  seventy  degree  turn  at  Waypoint  5, 
provided  the  smallest  FTE  in-turn  statistics.  This  fact  was  true  for  each  of 
the  VORTAC  data  sets  as  well  as  for  their  combined  samples.  Once  again,  as  in 
the  second  turn  in  this  set,  the  FTE  data  obtained  in  the  Millville  flights  was 
far  superior  to  that  in  the  Sea  Isle  VORTAC  flights.  The  tendency  of  the  pilot 
in  the  Sea  Isle  data  was  to  fly  with  a quarter  nautical  mile  bias  to  the  left 
of  course.  No  such  bias  existed  in  the  Millville  data.  The  2-sigma  value  fur 
the  Millville  data  in  this  turn  was  one-half  the  magnitude  encountered  in  the 
Sea  Isle  data.  The  combined  FTE  error  value  for  this  turn  attributed  a bias 
error  to  the  pilot  of  approximately  one-tenth  of  a nautical  mile  left  of  course, 
while  the  2-sigma  value  i'"dicated  a 1.2  nautical  mile  zone  around  that  bias 
error. 

In  summary,  the  data  analyzed  in  this  section  revealed  the  following  re- 
sults. It  was  found  that  severe  switching  transients  occurred  during  changes 
of  waypoint,  in  many  cases  result'  g in  large  SPI  deviation  magnitudes  and 
polarity  changes  with  respect  to  the  indicated  track.  Times  required  for  way- 
point  changes  varied  from  a few  seconds  to  approximately  one  minute,  and  in 
the  one  hundred  degree  turn  resulted  in  severe  overshoots  of  the  following  leg 
(of  up  to  3 nautical  miles).  Lack  of  turn  anticipation  resulted  in  severe 
overshoots  of  the  following  segment  in  all  but  a few  special  cases.  Finally, 
it  was  found  that  the  turn  magnitude  did  affect  the  FTE  statistics  in  this  ex- 
periment with  the  mean  error  values  providing  a more  general  diagnosis. 

Summary 

This  section  has  presented  a synopsis  of  experimental  data  regarding  area 
navigation  turn  performance  in  terminal  area  operations.  Both  FTE  data  and 
airspace  utilization  data  has  been  discussed  for  several  levels  of  RNAV  equip- 
ment. Specific  categories  of  turn  performance  were  discussed  including  turn 
performance  (FTE  and  radar  tracks)  without  any  type  of  turn  anticipation,  with 
procedural  turn  anticipation  and  with  automated  turn  anticipation  using  a 
warning  light.  Both  manual  and  autopilot  data  was  presented  for  the  latter 
category. 

The  major  findings  of  this  detailed  analysis  of  turn  performance  can  be 
summarized  as  follows: 

• Procedural  turn  anticipation  is  a minimum  operational  requirement. 

In  fact,  procedural  turn  anticipation  eliminates  the  need  for  addi- 
tional turn  overshoot  airspace  the  current  '2.0  nm  route  width 
specification  is  retained.  (Based  on  cockpit  simulator  data  of 
Sections  3.2.1  and  3.2.3). 

• An  automated  turn  anticipation  provided  substantial  reductions  in 
"In-Turn"  FTE  for  both  parallel  offset  and  centerline  tracking. 

The  automatic  turn  anticipation  light  should  be  considered  a valu- 
able improvement  in  any  RNAV  system  but  not  be  required  as  a minimum 
operational  characteristic  (see  Section  3.2.1). 

• Consistent  turn  undershoots  were  measured  for  both  the  manual  and 
autopilot  flight  tests  described  in  Section  3.2.2.  However,  no 
additional  undershoot  airspace  requirement  was  indicated  for  terminal 
area  operations  i_f  the  current  +2.0  nm  route  width  is  retained. 


Turns  without  any  form  of  procedural  or  automatic  anticipation 
resulted  in  severe  overshoots  of  unacceptable  magnitudes  (Section 
3.2.3  and  3.2.4). 


3.3  PARALLEL  OFFSET  PERFORMANCE 


Utilization  of  area  navigation  routes  offset  parallel  from  pre-defined 
charted  or  uncharted  parent  routes  was  a recommended  Task  Force  concept.  Nav- 
igation along  such  parallel  offset  routes  should  be  possible  using  the  parent 
route  waypoint  input  and  either  a specific  RNAV  computer  parallel  offset  func- 
tion or  a specified  pilot  procedure.  In  either  case  parallel  offset  flying 
should  not  require  additional  waypoint  input  information  to  define  the  parallel 
route  segments.  The  operational  utility  of  the  parallel  offset  route  concept 
was  aimed  at  applications  for  merging,  passing  or  sequencing  aircraft  as  shown 
in  Figure  3.32  for  enroute  and  terminal  area  operations.  Due  to  the  intuitive 
usefulness  of  these  concepts,  the  feasibility  and  accuracy  of  FTE  during  paral- 
lel offset  flying  was  a specific  test  variable  in  three  of  the  FTE  experiments. 
The  G-l/Collins  flight  tests  at  NAFEC  evaluated  parallel  offsets  on  an  experi- 
mental route.  These  efforts  were  of  5.0  nm  and  8.0  nm  right  and  left  of  the 
parent  route.  The  University  of  Illinois  also  evaluated  the  parallel  offset 
concept,  but  in  a Link  GAT  2 cockpit  simulator  rather  than  in  flight.  The 
cockpit  simulator  experiment  was  performed  using  an  experimental  route  compat- 
ible with  the  G-l/Collins  flight  test.  However , the  cockpi t simulator  experiment 
evaluated  3.0  nm  and  5.0  nm  right  and  left  offsets.  For  both  the  flight  test 
and  the  simulator  evaluation,  parallel  offsets  were  used  in  level  route  segments 
which  continue  around  turns  as  well  as  in  descending  flight  which  continued 
around  turns. 

The  experimental  flight  test  and  simulator  evaluations  were  supplemented  by 
operational  flight  test  results  obtained  from  the  A.C.  500/King  RNAV  evaluation 
performed  at  Denver's  Stapleton  International  Airport.  These  operational  tests 
provide  an  important  verification  of  the  acceptability  and  feasibility  of  the 
parallel  offset  used  in  the  ATC  environment.  The  response  to  an  ATC  request  to 
parallel  offset  and  the  resulting  track  must  be  compatible  with  the  desired  ATC 
maneuver.  This  section  will  present  statistical  results  and  graphical  illustra- 
tions of  the  accuracy  achieved  in  the  experimental  evaluations  of  the  parallel 
offset  concept.  These  quantified  results  will  then  be  followed  by  an  operational 
analysis  of  the  Denver  data. 

Figure  3.33  is  a combined  illustration  showing  the  B-1  route  used  in  the 
cockpit  simulator  evaluation  and  the  B-2  route  used  in  the  Collins  flight  test 
experiment.  These  two  routes  were  both  derived  from  the  standard  RNAV  terminal 
area  design  for  JFK  (see  Figure  2.2  in  Section  2.2).  These  routes  are  basically 
each  composed  of  a SID  and  STAR  and  a transition  segment  between  the  departure 
and  arri val  profi les . Each  route  was  designed  for  approximately  one  hour  dura- 
tion. The  reasons  for  using  different  routes  in  the  simulator  and  in  flight 
were  to  obtain  data  over  a different  sample  of  turn  angles  as  well  as  to  balance 
the  right  and  left  hand  turn  data.  In  addition,  time  and  monetary  constraints 
precluded  utilization  of  both  routes  by  each  data  source.  The  parallel  offset 
routes  indicated  in  Figure  3.33  are  not  to  scale  but  are  meant  to  define  areas 
where  level  route  segments  were  used  to  obtain  parallel  offset  data  including 
paralleling  around  turns. 

3.3.1  Aj r 1 j ne  Type  RNAV  System  Test su its 

Starting  with  the  Collins  flight  test  results.  Table  3.24  can  be  used  to 
discuss  FTE  as  well  as  Total  System  Cross  Track  (TSCT)  performance  during  paral- 
lel offset  maneuvers  compared  to  flights  which  used  the  parent  route  only.  This 


3-75 


r 


table  also  subdivides  the  Collins  flight  test  results  into  manual  and  autopilot 
flights.  There  are  two  very  striking  characteristics  of  the  Collins  flight  test 
data  which  become  apparent  from  inspection  of  rows  1 and  2 of  Table  3.24.  First 
of  all,  the  magnitudes  of  FTE  and  TSCT  error  are  extremely  small  for  both  aggre- 
gated five  and  eight  nautical  mile  offset  data  and  parent  route  data.  Second, 
there  were  no  significant  differences  in  either  FTE  or  TSCT  data  for  manual  vs 
autopilot  tracking.  Both  manual  and  autopilot  data  show  two  sigma  FTE  of  0.2  nm. 
Total  system  accuracy  for  manual  vs  autopilot  also  shows  no  apparent  difference. 
For  offset  vs  parent  routes,  a slight  (.02-. 07  nm)  increase  is  apparent  in 
parallel  offset  TSCT  for  manual  and  autopilot  flight.  This  could  be  due  to  small 
overshoots  and  undershoots  associated  with  offset  intercept,  but  the  magnitude 
of  increase  is  too  small  to  resolve  with  current  data  recording  and  reduction 
techniques.  The  reason  for  the  very  small  magnitudes  of  the  errors  tabulated 
is  probably  due  to  the  favorable  VORTAC  station  geometry  and  availability  around 
NAFEC  and  utilization  of  DME/DME  navigation  mode.  Also,  the  small  errors  reflect 
the  overall  quality  of  the  airborne  DME  receivers  and  the  RNAV  computer  computa- 
tional algorithms. 

A more  detailed  breakdown  of  the  offset  results  is  also  provided  in  Table 
' 3.24.  This  was  done  to  verify  that  the  negligible  mean  or  bias  errors  were 

i based  on  aggregation  of  negligible  biases  and  not  on  averaging  out  large  nega- 

j tive  and  positive  bias  numbers.  With  the  exception  of  the  three  shaded  mean 

errors  indicated  in  the  table,  all  Collins  Mean  FTE  and  TSCT  errors  were  less 
I than  0.1  nm  and  can  be  considered  negligible.  The  reason  for  the  three  larger 

I means  indicated  by  the  shading  is  well  known  and  will  be  discussed  subsequently. 

Table  3.24  G-l/Collins  Parallel  Offset  Summary  Data,  DME/DME  Mode 
(Route  B-2,  T-W,  W-X  and  X-Y  Route  Segments) 


•i 


4 

'i 


FTE 

TSCT 

DESIRTD 

NO. 

MEA’I 

' 2o 

MEAN 

‘2o 

DATA  BAST 

TRACK 

MODE 

FITS. 

Inn) 

(nm) 

(nm) 

(nm) 

1.  All  Segniciits  Combined 

i’drent 

Manual 

14 

0.06R 

0.23 

0.C3L 

0.32 

Autopilot 

14 

0.C2R 

0.19 

0.07L 

0.28 

?.  All  Offsets  Combined 

B&8,  R«,L 

Manual 

8 

0.07R 

0.22 

O.OIR 

0.34 

Autop  i 1 (it 

8 

0.00 

0.21 

0.07L 

0.3B 

3.  B nm  Offsets 

5 nm  RSL 

Manual 

4 

O.OBR 

0.17 

O.OBL 

0.28 

Autopilot 

4 

0.00 

0.24 

0.10. 

0..36 

5 nm  R only 

Manual 

2 

O.OBR 

0.22 

0.O7L 

0.28 

All  topi  lot 

2 

0.02L 

0.39 

0.;l;5t 

0.B6 

B i.m  L only 

Manual 

2 

O.OBR 

0.14 

0.04L 

0.27 

Autopilot 

2 

O.OIR 

0.10 

0.08L 

0.17 

4.  8 nm  Offsets 

8 nm  K%i 

Manual 

4 

O.OIR 

0.20 

0.02R 

0.34 

Autopi lot 

4 

O.OIR 

0.16 

0.041. 

0.32 

8 nm  R only 

Manual 

2 

0.11ft 

0.34 

0.09R 

0.34 

Autopi lot 

2 

0.02R 

0.22 

0.02R 

0.48 

8 tun  (.  only 

Manila  1 

2 

0.09R 

0.23 

0.00 

0.33 

Autopilot 

l - - - 

2 

O.OIR 

0.12 

0.071 

0.19 
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Inspection  of  the  two  sigma  errors  for  the  left  and  right  offsets  (rows  3 
and  4,  Table  3.24)  verifies  the  conclusion  reached  previously  that  no  signifi- 
cant decrease  occurred  in  autopilot  vs.  manual  navigation.  As  a matter  of  fact, 
the  autopilot  statistics  for  FTE  and  TSCT  on  five  nautical  mile  offsets  show 
poorer  perfoimance  than  manual  flying.  This  can  be  seen  from  the  0.39  nm  vs 
0.22  nm  FTE  for  five  mile  right  offsets  particularly.  Before  developing  the 
reason  for  this,  one  more  fact  should  be  pointed  out.  Even  considering  the 
largest  errors  shown  on  the  table  (5  nm  R only)  the  Collins  data  did  not  exceed 
0.39  nm  for  FTE  or  0.56  nm  for  TSCT  when  the  offset  flights  were  statistically 
aggregated. 

Figures  3.34  and  3.35  graphically  summarize  the  route  segment  data  obtained 
using  the  Collins  RNAV  system  in  parent  route  and  parallel  offset  tracking. 

These  plots  were  derived  from  tracking  radar  and  the  results  can  be  inspected 
and  compared  with  the  TSCT  statistical  treatment  previously  presented  since  TSCT 
error  data  was  also  derived  from  the  tracking  radar. 

Returning  to  the  apparent  indication  shown  in  Table  3.24  that  the  autopilot 
FTE  and  TSCT  performance  was  slightly  poorer  than  the  manual  performance.  Figures 

3.34  and  3.35  can  be  used  to  explain  this  statistical  observation.  Also,  Table 
3.25  should  be  referred  to  for  a breakdown  of  route  segment  statistics  more  com- 
patible with  the  figures  and  to  explain  the  larger  autopilot  errors.  This  table 
verifies  the  observation  that  the  autopilot  performance  was  worse  on  both  the 
5 and  8 nm  right  offsets.  In  fact,  the  largest  error  (0.77  nm)  was  recorded  from 
the  autopilot  aggregation  from  WHISKEY  to  XRAY  waypoints.  Also,  the  2 sigma  auto- 
pilot TSCT  was  twice  as  much  as  the  manual  TSCT  on  this  segment.  This  leads  to 
a very  important  observation.  The  cause  of  the  large  autopilot  errors  was  traced 
to  utilization  of  faulty  geometry  by  the  Collins  system  on  this  leg.  The  two 
humps  on  the  5 nm  right  offset  of  Figure  3.35  were  caused  by  using  stations  with 
an  included  angle  greater  than  150°.  It  should  be  pointed  out  that  the  Collins 
system  normally  would  have  downgraded  to  VOR/DME  in  this  circumstance,  but  for 
the  data  being  discussed,  the  Collins  system  was  restricted  to  solely  DME/DME 
operation  by  disconnecting  the  VOR  receivers.  Nevertheless,  this  data  is  repre- 
sentative of  (p,i)  navigation  and  the  reaction  of  the  autopilot  vs  the  human  pilot 
is  enlightening.  As  shown  in  Figure  3.35  the  autopilot  responded  by  following 
the  improper  (p,p)  guidance  until  the  geometry  problem  was  resolved  or  a different 
station  was  autotuned.  The  human  pilot's  performance  on  Figure  3.34  shows  that 
initial  reaction  was  the  same  but  that  the  signal  anomaly  was  recognized  and  ignored 
in  one  flight  and  smoothed  out  more  rapidly  on  the  other  flight. 

It  is  felt  that  the  geometry  problem  mentioned  was  responsible  for  the  larger 
mean  errors  (greater  than  0.1  nm)  shown  shaded  in  Table  3.24  as  well  as  for  the 
0.48. and  0.56  nm  autopilot  TSCT  errors.  The  0.34  nm  two  sigma  manual  error  was 
apparently  a result  of  the  turn  overshoot  on  the  8 nm  right  offset  abeam  WHISKEY 
waypoint.  This  overshoot  resulted  in  a continued  track  which  was  to  the  left  of 
desired  course  and  considerably  different  than  the  other  8 nm  left  offset  flight 
yielding  a large  two  sigma. 

Comparison  of  the  route  segment  statistics  from  XRAY  to  YANKEE  as  well  as 
visual  inspection  of  the  turn  at  WHISKEY  and  XRAY  waypoints  on  Figures  3.34  and  i 

3.35  shows  two  additional  interesting  points.  First,  the  autopilot  turn  perfor- 
mance is  more  repeatable  and  leads  to  smaller  overshoots  or  zero  overshoots  on  J 

the  outbound  track.  Second,  parallel  offset  operations  which_c_ontJ_nue_a round 

rP t cause  any^  route  width  problem  using  jtjie  autopJJ[oJ;_whereas_  in  jiianual 
mode,  turn  overshoots  of  up_  to  1 .0  nm  can  occur.  Further  substantiation  of  the 
latter  result  could  lead  to  a requirement  for  autopilot  coupling  capability  in 
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parallel  offset  operations  or  could  produce  a procedural  requirement  for  offset 
granularities  greater  than  minimum  separation  requi rements . 


3.3.2  FTE  During  Parallel  Offsets  with  Varying  Waypoint  Storage 

The  University  of  Illinois  evaluated  the  parallel  offset  concept  in  a LINK 
GAT  2 cockpit  simulator.  The  primary  experimental  variables  were  turn  anticipa- 
tion technique,  waypoint  storage  capability  and  the  magnitude  of  parallel  offsets. 
In  contrast  to  the  sophistication  inherent  in  the  Collins  ANS-70A  RNAV  system, 
the  3D-RNAV  system  used  in  the  cockpit  simulator  was  designed  to  represent  a sys- 
tem more  typical  of  the  general  aviation  type.  Since  the  system  was  experimental, 
and  information  regarding  its  operation  is  not  commonly  available,  a brief  des- 
cription of  the  control  display  unit  will  follow. 

The  3D  RNAV  system  developed  at  the  Aviation  Research  Laboratory  employs  a 
digital  CDU  (Figure  3.36)  and  a conventional  general  aviation  type  CDI  (Figure 
3.37).  Distance-to-waypoint  is  indicated  on  a digital  readout  located  above  the 
CDI  (Figure  3.37).  A turn  anticipation  indicator  light  is  located  above  the  al- 
titude indicator.  The  navigation  technique  was  varied  between  procedural  and 
indicator  light  for  turn  anticipation  and  1,  2 and  3 waypoint  storage  capacities 
during  the  FTE  experiment. 

To  illustrate  the  operation  of  the  system  the  most  complex  experimental 
condition  will  be  covered.  In  this  condition  a turn  anticipation  light  and 
three  waypoint  storage  capacity  are  provided.  Data  for  the  Atlantic  City  Two 
Departure  (first  half  of  route  B-1)  should  be  entered  as  follows: 

1.  Select  VORTAC  frequency 


a . 

FREQ: 

Depress 

b. 

Keyboard : 

108.6 

c . 

ENTER: 

Depress 

2.  Enter  waypoint  data  for  waypoints  BRAVO,  CHARLIE  and  KILO  in 
storage  registers  1,  2 and  3 respectively 


a. 

WPT  SET: 

Depress 

b. 

Keyboard: 

1 

c. 

ENTER: 

Depress 

d. 

RAD: 

Depress 

e. 

Keyboard : 

34.4 

f. 

ENTER: 

Depress 

g- 

DIST: 

Depress 

h. 

Keyboard : 

3.0 

i . 

ENTER: 

Depress 

j- 

CRS  in  DEG: 

Depress 

k. 

Keyboard : 

38 

1 . 

ENTER: 

Depress 

The  same  steps  (a.  through  1.)  will  be  followed  for  CHARLIE  and  KILO  way- 
points  using  storage  registers  2 and  3 respectively. 
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LEGEND  7 

1.  Data  Select  Buttons  - Enables  selection  of  data  entered  from  the  keyboard. 
The  FREQ  button  enables  the  selection  of  VORTAC  frequency  used  in  all  way- 
points  selected.  The  other  six  buttons  enable  the  selection  of  data  which 
is  dedicated  to  the  waypoint  selection. 

2.  Data  Readout  Lights  - Present  data  entered  from  keyboard  for  the  seven 
Data  Select  Buttons.  "L"  and  "R"  present  the  indication  of  left  or 
right  offset. 

3.  Waypoint  Set  Button  and  Readout  - Enables  selection  and  readout  of  the 
waypoint  for  which  data  is  entered. 

4.  Waypojnt  in  Use  Button  and  Readout  - Enables  selection  and  readout  of  the 
active  waypoint  for  navigation. 

5-  ScjiJe  - Selects  sensitivity  of  the  lateral  deviation 

indicator  in  nautical  miles  per  dot  on  the  display. 

6.  Enter  Bjjt ton  - Enters  selected  values  into  computer  under  the  appropriate 
categories'. 

7.  Keyboard  - Used  for  numerical  entry  of  all  data. 

8.  Confirm  - Enables  prestored  data  for  each  waypoint  to  be  checked. 

Figure  3.36  Control  Display  Unit  (CDU)  for  Entry  of  Navigation  Data 
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3.  Activate  waypoint  BRAVO  (1)  for  navigation. 


a. 

WPT  IN  USE:  Depress 

b. 

Keyboard : 

1 

c. 

ENTER: 

Depress 

As  the  BRAVO  waypoint  is  approached,  the  anticipation  indicator  will  light 
at  the  point  where  a standard  rate  turn  should  be  initiated  to  acquire  the  cen- 
terline of  the  outbound  course  from  BRAVO  with  minimum  overshoot.  Either  during 
the  turn  or  shortly  thereafter,  waypoint  CHARLIE  should  be  activated  to  provide 
course  deviation  indications  to  CHARLIE  as  follows: 


I 


i 


a.  WPT  IN  USE:  Depress 

b.  Keyboard:  2 

c.  ENTER:  Depress 

Because  of  the  requirement  for  turn  anticipation  indication,  the  system 
was  used  in  a "fly-to"  mode  at  all  times,  i.e.,  after  passing  one  waypoint,  acti- 
vate and  fly  to  the  next  waypoint.  One  consequence  of  the  turn  anticipation 
light  was  the  requirement  to  sequence  the  waypoints  as  follows:  1,2, 3,1.  For 
the  two  waypoint  system,  waypoints  were  sequenced:  1,2, 1,2. 

Following  the  activation  of  CHARLIE  waypoint,  storage  register  ONE  was 
used  to  enter  LIMA  waypoint  data  using  steps  2-a  through  2-1  above. 

When  an  offset  was  required,  the  traffic  controller  relayed  the  informa- 
tion to  the  pilot  in  the  form  of  a clearance.  After  receiving  the  clearance, 
the  pilot  entered  the  offset  for  each  waypoint  as  follows: 


a. 

WPT  SET: 

Depress 

b. 

Keyboard : 

Enter  number  of  waypoint  which  defines 
the  course  to  be  offset 

c. 

ENTER: 

Depress 

d. 

OFFSET: 

Depress 

e. 

Keyboard : 

L5  (for  five  mile  left  offset) 

f. 

ENTER: 

Depress 

The  direction  of  the  offset  (L  or  R)  was  selected  prior  to  selecting  the 
magnitude.  Repeat  a through  f for  all  waypoints  which  define  an  offset  course. 

When  a course  offset  was  in  use,  an  indicator  light  located  on  the  CDI  in- 
dicated a left  or  a right  offset.  When  an  offset  of  zero  was  selected  (center- 
line  tracking),  there  was  no  such  indication  on  the  CDI.  In  both  cases  the  pro- 
per tracking  procedure  is  to  steer  the  aircraft  so  as  to  center  the  needle. 

The  preceding  description  was  provided  to  supply  the  reader  with  the  proper 
foundation  for  evaluating  the  statistical  results  of  the  cockpit  simulator  paral- 
lel offset  data.  This  description  was  abbreviated  somewhat  but  was  essentially 
the  information  supplied  each  subject  pilot  prior  to  the  first  flight.  In  addi- 
tion to  the  written  system  operation  instructions,  each  subject  was  given  approx- 
imately one  hour  of  classroom  instruction  and  a single  one  hour  orientation  flight 
prior  to  data  collection. 

The  reason  for  this  detailed  explanation  of  system  operation  becomes  ob- 
vious when  the  statistical  FTE  results  of  Table  3.26  are  examined.  This  table 
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shows  nearly  a 25%  increase  in  two  sigma  FTE  when  data  from  all  offset  flying 
is  compared  to  data  over  the  same  segments  on  the  parent  track  (0.288  nm  to 
0.354  nm).  It  is  felt  that  this  increase  in  offset  FTE  is  related  to  the  input 


characteristics  and  workload  of  the  CDU  employed  which  required  six  keyboard 
entries  for  each  offset  and  eighteen  keyboard  entries  for  each  waypoint.  This 
is  in  direct  contrast  to  the  Collins  parallel  offset  data  which  showed  only  a 
0.03  nm  increase  in  FTE  comparing  offset  to  non-offset.  Table  3.26  illustrates 
two  other  points.  First,  there  were  no  significant  systematic  differences 
between  flying  offset  to  the  left  (inside  track)  compared  to  flying  offset  to 
the  right  (outside  track).  The  former  showed  an  average  FTE  of  0.363  nm  for 
5L  and  3L  (inside  track)  offsets  while  the  5R  and  3R  (outside  track)  offsets 
showed  an  average  FTE  of  0.349  nm.  Finally,  Table  3.26  shows  that,  like  the 
Collins  data,  no  significant  bias  errors  were  recorded. 

Table  3.26  Cockpit  Simulator  Parallel  Offset  FTE  Data 
(1,2,3  Waypoint  Storage  Combined) 


±2  Sigma 
(nm) 

Mean 

(nm) 

Total  Aggregate 

Parent 

.288 

.024R 

All  Offsets 

.354 

.020R 

3R  and  3L 

.368 

.024R 

5R  and  5L 

.340 

.016R 

Individual  Offsets 

3R 

.368 

.034R 

3L 

.364 

.009R 

5R  ■ 

.330 

.013R 

5L 

.362 

.022R 

The  next  obvious  question  is:  What  effect  was  observed  for  parallel  offset 
FTE  as  waypoint  storage,  and  consequently,  workload  was  varied?  Table  3.27 
summarizes  the  aggregated  statistical  results  for  each  set  of  offset  data  as  a 
function  of  1 , 2 and  3 waypoint  storage.  This  table  further  substantiates  the 
previous  conclusion  that  FTE  in  parallel  offset  flying  was  substantially  larger 
than  FTE  for  parent  route  flying  for  both  the  two  and  three  waypoint  storage 
capabilities  tested.  This  is  true  because  both  of  these  storage  capabilities 
allow  the  updating  of  waypoint  data  and  the  associated  workload  during  what  is 
normally  considered  steady  state  tracking.  That  is,  the  two  and  three  waypoint 
RNAV  system  user  generally  updates  the  RNAV  stored  data  during  periods  of  straight 
segment  tracking  while  the  single  waypoint  RNAV  system  user  updates  in  the  near 
proximity  of  a turn  (‘5  nm  from  the  waypoint).  Since  the  data  shown  in  Table 
3.27  is  steady  state  and  does  not  include  the  portion  of  the  track  where  the 
single  waypoint  user  is  updating,  there  is  no  attendent  increase  in  offset  vs 
non-offset  FTE  for  the  single  waypoint  system. 

Closer  examination  of  Table  3.27  shows  that  the  three  waypoint  parallel 
offset  FTE  is  consistently  larger  than  either  the  one  or  the  two.  In  fact. 


i 

Table  3.27  Cockpit  Simulator  Parallel  Offset  FTE  Related  to 

Waypoint  Storage 


i 

Mean 

(nm) 

' Total  Aggregate 

Iwp 

2wp 

3wp 

Parent 

.296 

.220 

.322 

.060R 

.024L 

.014L 

All  Offsets 

.298 

.276 

.458 

.037R 

.01  OR 

.012R 

3R  and  3L 

.260 

.240 

.522 

.042R 

.018R 

.012R 

) 5R  and  5L 

i 

.332 

.304 

.376 

.031R 

.003R 

.013R 

1 Individual  Offsets 

3R 

.230 

.216 

.548 

.042R 

.017R 

.041R 

3L 

.302 

.276 

.460 

.042R 

.020R 

.035L 

5R 

.300 

.312 

.372 

.014R 

.009R 

.016R 

5L 

.384 

.286 

.390 

.OOIL 

.004R 

the  three  waypoint  storage  FTE  data  was  even  larger  than  the  one  or  the  two 
for  parent  route  tracking.  This  is  again  due  to  the  large  number  of  keyboard 
entries  required  to  update  waypoint  information  using  the  COU  tested  and  the 
fact  that  the  three  waypoint  user  had  to  keep  track  of  and  update  two  non- 
active waypoints  while  navigating  using  one  active  waypoint.  This  combination 
detracted  from  the  normal  steady  state  tracking  accuracy  as  indicated  by  the 
larger  FTE  values. 

3.3.3.  Minimum  System  Operational  Tests  of  the  Para IJ^l  .Offse_t 

Utilization  of  the  Task  Force  concept  of  parallel  offset  routes  was  dem- 
onstrated using  a minimum  capability  RNAV  system  in  the  operatonal  environment 
of  the  Denver  terminal  area.  This  subsection  concentrates  on  the  operational 
aspects  of  the  parallel  offset  maneuver  since  the  number  of  flights  available 
was  too  small  to  provide  meaningful  statistical  results.  Such  questions  as: 

"Was  the  aircraft  able  to  achieve  the  desired  offset  track,  was  the  same  offset 
track  repeatable  on  different  flights  and  are  spacing  maneuvers  possible  using 
a procedural  parallel  offset  technique  of  flying  a decentered  GDI  neeole?"  are 
addressed.  A total  of  four  parallel  offsets  were  requested  by  the  air  traffic 
controller  during  the  18  data  gathering  flights  at  Denver  using  the  King  RNAV 
system.  Two  of  the  parallel  offsets  were  on  the  TRAIL  ONE  arrival,  GOLF  trans- 
ition to  runway  35  and  two  were  on  the  TRAIL  ONE  arrival,  FRED  transition  to 
runway  26L.  Both  of  these  arrival  routes  were  set  up  to  accommodate  an  easterly 
traffic  flow.  The  results  from  all  the  parallel  offset  data  will  be  presented 
by  discussion  of  the  RNAV  indicated  position  and  the  ARTS  III  radar  tracks 
shown  in  Figures  3.38  to  3.42. 

Figure  3.38  shows  the  first  ""RAIL  ONE  arrival,  GOLF  transition  to  runway 
35.  It  is  interesting  to  note  that  the  request  for  a parallel  offset  came  on 
the  first  flight  of  the  program  (designated  DEN  01  on  Figure  3.38).  The  A1C 
request  for  a 4.0  nm  left  offset  was  issued  to  al low  overtaking  traffic  to  runway 
26L,  which  used  the  same  BYERS  to  FRED  route  segment,  to  pass  the  test  aircraft. 
At  this  time  the  test  aircraft  distance  to  FRED  waypoint  was  approximately 
8.0  nm.  The  aircraft  was  initially  on  centerline  and  the  GDI  indication  at 
this  time  showed  less  than  '2  dot  fly  left.  The  transition  from  the  parent 
route  to  the  desired  4.0  nm  left  offset  was  smooth  and  acceptable  to  both  the 
pilot  and  the  controller.  A 45”  heading  change  was  used  by  the  pilot  to  inter- 
cept the  offset  course.  Figure  3.39  shows  the  second  parallel  of^^set  on  this 
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same  arrival  route.  This  offset  was  requested  inrnediately  following  the  (p,  9) 
update  to  FRED  waypoint.  At  this  time  the  aircraft  was  approximately  1.0  nm 
right  of  parent  route  centerline  but  the  RNAV  indicated  position  displayed  to 
the  pilot  was  2 dots  nr  ? nm  >"ight  of  course.  This  relative  position  discrepancy 
between  displayed  and  actual  position  did  not  apparently  affect  the  acceptability 
of  the  4.0  nm  left  offset  track  acquisition.  The  reason  for  the  discrepancy  is 
documented  in  Section  3.9.  Once  the  offset  track  was  achieved,  excellent  track 
keeping  ability  was  demonstrated  following  a GDI  needle  which  read  4.0  nm  or  4 
dots  fly  right  for  the  duration  of  the  offset  (5.0  dots  is  the  pegged  needle 
position  right  or  left).  The  mean  FTE  error  calculated  for  the  entire  length  of 
the  parallel  offset  was  0.25  nm  to  the  left  of  the  desired  track  (fly  right)  as 

indicated  by  the  dotted  line  in  Figure  3.39.  This  is  better  than  would  be  expected 

using  a display  sensitivity  of  a 1.0  nm/dot.  Similarly,  the  average  total  system 
error  (TSCT)  for  the  duration  of  the  flight  on  the  parallel  offset  was  0.12  nm 

to  the  right  of  desired  course  as  indicated  by  the  solid  black  line  in  the  figure. 


Figure  3.40  is  a composite  of  the  two  4.0  nm  left  offsets.  This  figure  does 
not  report  the  RNAV  position  or  all  of  the  radar  data.  This  plot  was  meant  to 
illustrate  the  consistency  with  which  the  offset  was  flown  on  two  different  flights 
as  well  as  the  consistency  of  acquiring  the  parent  route  in  the  FRED  to  PINE  route 
segment.  In  both  cases  the  transition  was  acceptable  to  ATC  and  reported  easy  to 
perform  by  the  pilot. 

Figures  3.41  and  3.42  show  the  results  of  4.0  nm  parallel  offsets  on  the 
straight  in  TRAIL  ONE  arrival  FRED  transition  to  runway  26L.  In  Figure  3.41  the 

4.0  nm  right  offset  was  initiated  at  BYERS  waypoint  while  flying  in  the  "FROM" 

RNAV  mode.  The  pilot  updated  the  waypoint  (p,  e)  inputs  to  FRED  waypoint  while  .. 

in  the  transition  to  the  parallel  offset.  This  is  not  an  especially  good  pro-  H 

cedure,  first,  since  loss  of  RNAV  guidance  occurs  for  20-40  seconds  while  the 
(p,.e)  input  is  being  inserted  and  second,  because  equipment  discontinuities  do 
occur  due  to  shifts  in  polarity  when  sequencing  from  flying  in  the  "FROM"  mode 
to  flying  "TO"  the  new  waypoint.  Both  of  these  factors  can  lead  to  overshooting 
the  desired  offset  course.  Therefore,  sequencing  waypoints  is  not  recommended 
while  transitioning  to  or  from  an  offset  course.  The  particular  transition  illus-  ^ 

trated  in  Figure  3.41  included  two  small  procedure  errors:  1)  an  RNAV  distance  ' 

input  of  28.5  nm  instead  of  29.5  nm  for  the  BYERS  waypoint  and  2)  an  OBS  setting 
of  255°  instead  of  257.7°  for  the  BYERS-FRED-MAP  tracks.  The  "From"  track  was  j 

continued  until  3.5  nm  (GDI)  from  desired  track,  at  which  time  a waypoint  change- 

over to  FRED  took  place.  Once  the  RNAV  update  was  completed  the  GDI  showed  a 
fly  full  left  indication  of  5.0  nm  (needle  pegged).  This  GDI  needle  pegged  con- 
dition  remained  for  about  1.0  nm  at  which  time  it  began  to  decrease  in  magnitude 
due  to  the  pilot's  corrective  action  of  a 45°  heading  change.  Notice  on  this 
track,  also,  a gradual  increase  GDI  fly  left  indication  from  the  desired  ^ 

4.0  dots  to  a maximum  deflection  of  4.9  dots  that  coincided  with  an  actual  track  ^ 

offset  of  the  desired  4.0  nm  right  of  track.  The  RNAV  system  error  was  almost 

1.0  nm  in  this  region  (computer  + sensors).  The  pilot  ignored  the  initial  GDI  ^ 

deflections,  and  only  when  the  GDI  showed  a fly  left  of  5.0  dots  (desired  was  4.0  •, 

dots)  did  he  make  proper  heading  correction.  Once  the  aircraft  was  flown  back 

to  the  desired  indicated  GDI  of  4.0  dots  (fly  left),  the  pilot  requested  end  of 

offset  and  began  a 45°  heading  transition  to  the  parent  track.  At  this  time  the  1 

ATG  controller  requested  the  test  aircraft  to  use  runway  26  right  instead  of  the  j 

preplanned  26  left.  The  pilot  reacted  to  this  request  by  initiating  a 1.0  nm 

right  offset  in  the  final  approach  segment  (FRED-MAP)  which  was  flown  until 
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3.0  nm  to  the  approach  threshold  of  runway  26R  at  which  time  the  test  was  ter- 
minated. An  almost  steady  RNAV  navigational  error  of  0.8  nm  can  be  seen  during 
this  approach,  which  favored  the  aircraft  actual  track  to  runway  26L  and  not 
26R.  Although  che  GDI  indicated  RNAV  position  was  near  the  desired  1.0  nm  right 
offset,  and  both  the  GDI  enroute  and  approach  sensitivity  modes  were  respectively 
selected,  both  scale  factors  consistently  showed  the  proper  GDI  indication  for  an 
approach  to  26R  while  the  RNAV  system  error  resulted  in  the  aircraft  being  closer 
‘ to  the  centerline  of  26L.  Along  track  average  data  showed  the  FTE  was  0.58  nm 

to  the  right  of  the  desired  4.0  nm  right  offset  and  TSGT  was  0.39  nm  to  the  left 
of  the  desired  offset  course.  This  consistent  discrepancy  in  RNAV  indicated 


position  and  radar  position  is  observed  in 
segment  the  average  track  showed; 

Figure  3.41.  In  the  FRED  to  MAP  route 

FTE 

TSGT 

SGALE  FAGTOR 

.03R 

.68L 

,25  nm/dot 

.08R 

.78L 

1.0  nm/dot 

The  observed  differences  between  actual  aircraft  position  (TSGT)  and  the  position 
indicated  to  the  pilot  by  the  GDI  (FTE)  is  due  to  the  combined  effect  of  ground 
and  airborne  navigation  equipment  errors,  RNAV  computer  error  and  display  errors. 
This  difference  has  been  observed  and  reported  in  Reference  8.  Thjs  daj^a  ^uj>- 
stantiates  the  potentia 1 problem  observed  in  the  reference  with  parallel  offset 

flying  using  a decentered  needle. This  type  of  parallel  offset  flying  is  oper- 

ati onal ly  unacceptable. 

These  results  are  especially  unacceptable  in  the  parallel  runway  situation 
where  a nominal  1.0  nm  separates  the  runway  centerlines.  This  particular  flight 
did  not  demonstrate  acceptable  performance  of  either  the  4.0  nm  or  the  1.0  nm 
right  offsets  due  to  the  RNAV  system  error  noted.  This  flight  did  document  one 
potential  negative  factor  regarding  the  use  of  RNAV  as  an  approach  aid  in  a par- 
allel runway  situation  where  precision  approach  aids  are  available. 

Figure  3.42  shows  the  same  TRAIL/FRED  arrival  as  just  discussed.  This 
particular  flight  utilized  a 4.0  nm  left  of  track  offset  but  unfortunately  due 
to  an  ARTS  III  data  dropout,  actual  track  data  was  not  available  for  the  major 
portion  of  the  offset.  This  figure  was  presented  to  reinforce  the  previous  con- 
clusion regarding  the  use  of  RNAV  as  an  approach  aid.  Figure  3.42  shows  a typical 
ILS  approach  to  runway  26L  which  is  very  smooth  and  never  more  than  0.2  nm  right 
or  left  of  course. 


3.4  DELAY  FAN  AND  DIRECT  TO  PROCEDURES 

As  the  number  cf  RNAV  equipped  aircraft  increases,  extensive  use  of  the 
parallel  offset  function  to  achieve  required  separation  and  spacing  on  final 
approach  was  anticipated  by  the  Task  Force  [2].  Due  to  the  generally  shorter 
route  segments  inherent  in  terminal  area  operations,  a modified  use  of  the 
parallel  offset  function  was  suggested  by  the  Task  Force  and  the  term  "Delay 
Fan"  was  coined.  Figure  3.43  illustrates  the  Task  Force  concept. 


Waypoint 

A 


Traffic  Flo 


Established  Route 


Waypoint 

B 


Figure  3./'-2  TYPICAL  AREA  NAVIGATION  DELAY  FAN 


The  flight  paths  shown  in  Figure  3.43  can  be  achieved  using  any  of  several 
ATC  instructions,  such  as,  “DELAY  RIGHT  2.0  nm"  or  "OFFSET  RIGHT  3.0  nm"  and 
"DIRECT  TO  WAYPOINT  B".  However,  operational  experience  in  the  Denver,  Miami_ 
and  Chicago  terminal  areasHiaTTFown  tFa t the  a i r traffic  controller  does  not 
conventionally  know  beforehand  what  precise  deTay  distance  is  required  to 
achieve  the  spacing  or  sequencing  Tesired.  This  fact  has  led  to  the  usage  of 
rpcraTlel'bTfsercbmmand  such  as  "PARALLEL  OFFSET  RIGHT  OF  COURSE  10  nm".  The 
utilization  of  a greater  specified  offset  distance  than  is  actually  required 
allows  the  controller  the  flexibility  of  turning  the  aircraft  back  to  the  ori- 
ginal course  either  earlier  than  the  specified  offset  or  letting  the  aircraft 
intercept  and  fly  the  10  nm  offset.  For  example,  if  the  10  nm right  offset  was 
initiated  to  allow  aircraft  number(J)in  Figure  3.43  to  cross  waypoint  B in 
front  of  aircraft  number([^ with  the  desired  spacing,  then  aircraft  number(j) 
could  be  given  a "PROCEED  DIREcT  TO  WAYPOINT  B"  command  at  the  I.O,  2.0  or  5.0  nm 
offset  points.  This  could  be  done  at  the  discretion  of  the  control le*'  consis- 
tent with  the  desircc  lateral  and  longitudinal  spacing.  In  addition,  the  con- 
troller can  safely  direct  his  attention  from  aircraft(^as  long  as  the  offset 
command  is  still  in  force,  since  he  knows  precisely  what  the  aircraft  will  be 
doing  and  how  much  airspace  is  required.  This  combined  utilization  of  the  RNAV 
parallel  offset  and  "Direct  To"  functions  to  effect  a "Delay  Fan"  has  been 
called  a "Tactical  Fan"  procedure. 
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3.4.1  Airline  RNAV  System 

The  preceding  section  described  the  Task  Force  concept  of  the  Delay  Fan 
and  how  that  concept  has  been  modified  in  practical  applications.  This  discus- 
sion was  presented  to  emphasize  two  points.  First  of  all,  RNAV  capability  to 
execute  the  Delay  Fan  is  predicated  on  two  functions;  the  parallel  offset  and 
the  "Direct  To".  Second,  the  utility  of  the  Delay  Fan  procedure  from  an  ATC 
viewpoint  hinges  strongly  on  the  reliability  and  repeatability  of  the  RNAV  air- 
craft flight  paths  which  result  from  an  ATC  request  for  a "Tactical  Fan".  The 
presentation  which  follows  addresses  both  of  these  points,  using  actual  aircraft 
flight  profiles.  These  flight  profiles  were  obtained  from  operational  flight 
tests  at  Miami  and  Denver  and  from  an  experimental  flight  test  using  the  NAFEC 
test  facility.  The  operational  data  was  taken  using  a light  twin  aircraft 
equipped  with  a single  waypoint  analog  RNAV  system.  This  data  addresses  pri- 
marily the  ability  of  this  type  of  system  to  execute  the  "Direct  To"  procedure. 
Previous  parallel  offset  data  on  this  same  aircraft/RNAV  system  was  presented 
in  Section  3.3.  The  experimental  flight  test  at  NAFEC  was  performed  using  a 
Gulfstream  I/Collins  ANS-70A  test  bed.  The  experimental  data  from  these  tests 
is  applicable  to  airline  operations  and  addresses  both  the  Delay  Fan  and  the 
"Direct  To"  functions  and  accuracy. 

Figure  3.44  presents  a graphical  aid  to  demonstrate  the  base  leg  parallel  offset 
routes  tested  during  the  Collins  experiments.  The  base  leg  offsets  were  per- 
formed in  addition  to  the  normal  aircraft  and  communication  workload  associated 
with  preparation  for  final  approach.  All  flights  from  waypoint  G to  waypoint 
H were  performed  while  descending.  Results  from  the  flight  profiles  illustrated 
are  presented  in  the  following  discussion. 

Since  the  Task  Force  concept  of  the  Delay  Fan  was  developed  to  alleviate 
anticipated  separation  and  spacing  problems  in  the  final  approach  area,  the 
Collins  flight  test  evaluated  the  Delay  Fan  procedures  on  the  base  leg  route 
segments  for  approaches  to  runway  04  from  the  west  and  runway  13  from  the  south. 
Figure  3.45  summarizes  the  results  of  these  tests. 

The  desired  Delay  Fan  profiles  are  shown  on  the  left  half  of  Figure  3.45. 
Waypoints  G and  H define  the  base  leg  for  an  approach  to  runway  04  while  way- 
points  G and  BB  define  the  base  leg  for  an  approach  to  runway  13.  On  both  of 
these  route  segm-ants,  the  desired  Delay  Fan  route  profile  is  shown  and  the  air- 
space required  to  perform  the  Delay  Fan  is  shaded.  Also  shown  on  the  desired 
profiles  is  the  aircraft  heading  change  of  45°  which  is  expected  by  ATC  when  a 
parallel  offset  instruction  is  given.  The  route,  the  airspace  and  the  45°  In- 
tercept jrpcedu  re.  are _a1J _ imperian Li  a s . w ill  _ be . ieen.  i a.  tiie . f o 1 1 owing  discussion 
of  the  G - 1/C.ol  1 ins.  .actual.^reLcks . 

However,  the  experimental  results  on  the  Collins  system  must  be  qualified. 

First  of  ell,  the  relatively  uncongested  air  traffic  environment  at  NAFEC  is 
not  typical  of  terminal  area  operations  in  the  ATC  envi*'onment.  This  leads  to 
less  pilot  stress  and  lower  pilot  workload  from  air  traffic  awareness  and  com- 
munications workload  viewpoints.  Secondly,  during  these  experiments,  the  Delay 
Fan  clearance  and  "Direct  To"  clearance  were  not  given  in  an  impromptu  manner 
typical  of  that  expected  in  the  terminal  area.  As  noted  in  the  previous  discus- 
sion of  the  Delay  Fan  concept,  the  controllers  do  not  generally  have  a pre- 
defined requirement  for  a Delay  Fan  or  a knowledge  of  the  magnitude  required 
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for  the  offset  or  when  it  should  be  terminated  with  a "Direct  To"  command.  In 
contrast,  the  clearance  given  the  subject  pilots  at  NAFEC  was; 

"No  later  than  10  mile  DTW  G,  insert  a 3 mile  left  (right)  offset 
instruction  to  start  upon  passing  WP  G.  Upon  reaching  the  3 mile 
left  (right)  offset  course,  turn  right  (left)  and  proceed  direct 
to  WP  H (BB). 

Even  though  this  clearance  is  somewhat  more  detailed  and  less  extempor- 
aneous than  would  actually  be  expected,  the  resulting  aircraft  tracks  provide 
an  interesting  insight  into  the  functional  performance,  the  airspace  require- 
ments and  repeatability  of  both  manual  and  autopilot  aircraft  guidance  on  De- 
lay Fans  terminated  in  the  "Direct  To"  fashion. 

On  the  right  half  of  Figure  3.45  are  the  six  flight  profiles  which  resulted 
from  the  first  series  of  Collins  flights.  These  initial  flights  were  flown  in 
the  DME/DME  navigation  mode,  which  should  be  intrinsical ly  more  accurate  and 
stable  than  VOR/DME  navigation.  Of  the  six  flight  profiles  shown,  two  were  man- 
ual flights  and  four  were  fown  in  the  autopilot  coupled  mode.  Flights  num- 
bered 1 and  2 were  themanual  flights  and  will  be  discussed  first.  Comparing 
the  actual  aircraft  tracks  from  flights  1 and  2 with  the  shaded  airspace  (de- 
sired path  defines  the  perimeter  of  the  shaded  airspace)  and  with  each  other 
results  in  three  observations.  First  of  all,  both  pilots  did  an  exceptional 
job  of  turning  the  aircraft  45°  to  the  desired  heading  for  intercepting  the 
3 nm  parallel  offset.  However,  on  flight  2,  the  pilot  was  late  in  turning  to 
intercept  the  offset  which  led  to  a later  problem.  Second,  both  pilots  did  excep- 
tionally well  in  acquiring  the  3.0  nm  offset  track  with  minimal  overshoot. 

Third,  both  flights  1 and  2 utilized  significantly  more  airspace  in  proceeding 
direct  to  H waypoint  than  would  be  expected.  In  the  case  of  aircraft  number 
1,  this  was  probably  an  acceptable  overshoot  due  to  the  lack  of  any  traffic  be- 
tween the  desired  fan  and  the  final  approach  course.  However,  in  the  case  of 
aircraft  number  2,  if  in  the  real  case  this  type  of  Delay  Fan  were  given  to 
provide  spacing  for  another  aircraft  on  a straight-in  final  approach,  then  the 
delay  in  executing  the  45°  parallel  offset  intercept  and  the  subsequent  airspace 
used,  which  was  much  closer  to  the  final  approach  course  than  necessary,  would 
be  unacceptable. 

Two  conclusions  can  be  drawn  from  the  manual  Delay  Fan  traces  discussed. 
First  of  all,  evidently  the  functional  capability  is  acceptable  insofar  as 
achieving  the  desired  45°  intercept  course  to  the  parallel  offset.  However, 

RNAV  pilot  procedures  must  stress  the  necessity  to  initiate  the  45°  heading 
change  precisely  when  specified  by  the  air  traffic  controller.  Secondly,  uti- 
lization of  some  type  of  turn  anticipation  technique  would  minimize  the  airspace 
required  once  the  Delay  Fan  has  been  terminated  and  the  "Direct  To"  command  has 
been  issued.  In  the  actual  ATC  environment,  this  latter  conclusion  may  be  im- 
possible since  termination  of  the  fan  is  an  impromptu  occurrence.  However,  in 
the  case  of  the  type  of  clearance  issued  during  these  experiments,  which  may 
apply  to  airspace  which  is  set  aside  specifically  for  Delay  Fans  in  some  future 
RNAV  environment,  anticipation  of  intercepting  the  3.0  nm  offset  and  early  roll- 
in  to  the  necessary  course  change  to  proceed  direct  to  H might  be  a procedural 
requirement  from  a controller  viewpoint. 

In  the  case  of  the  autopilot  Delay  Fans  represented  by  aircraft  tracks 
number  3 and  4,  two  new  functional  and  airspace  problems  are  illustrated.  Flight 
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Figure  3.45  Delay  Fan  Procedures  Using  an  Airline  Type  RNAV  System 


number  3 received  the  same  instructions  previously  shown  for  the  manual 
flights.  However,  for  some  reason  and  through  usage  of  other  known  information 
stored  on  the  Collins  system,  it  appears  that  the  pilot  sequenced  waypoints 
from  G to  BB  and  proceeded  along  this  route  segment  until  the  3.0  nm  offset 
course  was  intercepted.  This  resulted  in  an  atypical  offset  intercept,  but  coin- 
cidently  the  "Direct  To"  H segment  was  precisely  along  the  desired  track.  Al- 
though this  type  of  maneuver  based  on  prestored  RNAV  data  is  not  expected  to 
be  typical  once  Delay  Fan  procedures  are  understood,  it  does  represent  a plau- 
sible blunder  in  the  early  RNAV  phases. 

Flight  number  4 was  also  an  autopilot  flight.  As  was  seen  in  the  manual 
flight  number  2,  the  pilot’s  initial  delay  in  activating  the  parallel  offset 

fur  '■.ion  at  G waypoint  leads  to  a serious  flight  excursion  into  final  approach  i 

airspace.  In  fact,  more  than  three-fourths  of  the  actual  aircraft  track  was  j 

outside  the  airspace  normally  expected  to  be  used  for  the  Delay  Fan  maneuver. 

In  addition,  an  RNAV  software  problem,  which  was  subsequently  corrected,  caused 
a rather  curious  turn  to  the  right  of  the  3.0  nm  offset  course.  The  software 
in  use  for  this  flight  did  not  cancel  or  override  the  parallel  offset  when  a 
"Direct  To"  waypoint  H was  activated.  The  autopilot  was  consequently  taking  the 
aircraft  to  a course  offset  from  H by  an  additional  3 nm.  This  turn  proceeded 
to  a point  approximately  1.25  nm  to  the  right  of  the  3.0  nm  offset  before  the 
"Direct  To"  H maneuver  was  initiated  manually.  The  remainder  of  this  flight  was 
flown  uncoupled.  This  flight  reinforces  the  need  for  stressing  the  proper  pilot 
procedures  in  initiating  and  terminating  Delay  Fans  whether  navigating  manually 
or  with  the  aid  of  an  autopilot. 

. 

Flight  test  tracks  numbered  5 and  6 on  the  lower  half  of  Figure  3.45 
were  also  in  the  autopilot  mode.  These  two  flights  were  given  clearance  for  ^ 

an  ILS  approach  to  runway  13  as  an  impromptu  change  (runway  4 was  expected). 

The  impromptu  final  approach  clearance  was  given  prior  to  the  request  for  the 
parallel  offset  and  the  wording  of  the  Delay  Fan  request  was  as  stated  pre- 
viously. The  additional  workload  associated  with  this  impromptu  runway  change  ; 

did  not  seem  to  affect  the  profile  of  flight  5.  This  track  is  very  similar  to  , 

track  1 in  its  relationship  to  the  shaded  airspace  and  desired  track.  The  com- 
ment made  previously  on  utilizing  an  early  roll-in  to  the  "Direct  To"  course 
applies  to  flight  5.  This  flight  overshot  the  desired  3.0  nm  offset  by  0.6  nm. 

Flight  6 is  a phenomenon  quite  unique  when  compared  to  flights  1-5.  On 
this  flight  in  the  autopilot  mode,  the  pilot  committed  a serious  blunder  in  his  j 

initial  attempt  to  input  the  impromptu  clearance  and  subsequent  offset.  The  » 

blunder  occurred  due  to  sequencing  from  the  STAR  to  runway  04  to  the  STAR  to 
runway  13.  Since  waypoint  V (which  precedes  G)  was  common  to  both  STARs,  and  , 

since  the  pilot  knew  he  wanted  to  eventual ly  sequence  "Direct  To"  waypoint  BB,  he 
decided  to  cancel  V on  the  flight  plan  page.  Thus  navigation  information  for 
his  current  route  segment  V to  G was  lost.  Attempts  at  reinserting  V were  unsuc- 
cessful , It  was  decided  to  terminate  the  preplanned  test  scenario  and  proceed 
direct  to  waypoint  BB.  Although  this  procedure  demonstrates  the  flexibility  of 
area  navigation  and  the  "Direct  To"  capability  in  general,  this  aircraft  track 
should  be  considered  an  unacceptable  response  to  the  experimental  clearance  i 

given.  Any  similar  excursions  in  response  to  actual  controller  commands  would 
certainly  diminish  controller  confidence  in  RNAV  Delay  Fan  procedures  and  hence 
limit  controller  usage  of  this  advantageous  spacing  maneuver. 
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3.4.2  General  Aviation  RNAV  System 


As  stated  in  the  introduction  to  this  section,  the  operational  flight  test 
results  are  more  pertinent  to  straightforward  analysis  of  the  "Direct  To"  RNAV 
function.  The  general  aviation  category  of  RNAV  equipment  was  evaluated  in 
operational  flight  test  programs  in  Miami  and  Denver  terminal  areas.  During 
these  tests  of  a single  waypoint  analog  RNAV  system  in  a light  twin  aircraft,  2 
Delay  Fan  and  8 "Direct  To'  procedures  were  used  which  allowed  the  air  traffic 
controller  to  expedite  traffic  flow.  Figure  3.46  shows  "Delay  Fan"  or  "Tacti- 
cal Fan"  data  using  the  single  waypoint,  analog  RNAV  system.  This  data  is 
similar  to  the  Collins  data  previously  plotted  in  Figure  3.45.  The  operational 
feasibility  and  the  absolute  aircraft  track  for  a 4.0  nm  right  offset  issued  by 
ATC  and  cancelled  by  a Direct  To  is  illustrated  in  the  figure.  On  the  SHAWN/ 

FRED  arrival,  the  fan  was  terminated  at  approximately  3.0  nm  off  desired  track 
while  the  Tf’AlL/FRED  offset  was  cancelled  when  the  aircraft  was  only  1.0  nm 
into  the  offset.  In  both  cases,  the  aircraft  responded  quickly  and  to  the 
satisfaction  of  the  air  traffic  controller.  Also  in  both  cases  the  transition 
back  to  the  parent  route  was  achieved  with  minimum  usage  of  airspace  even 
though  the  transition  direct  to  COAL  waypoint  required  a 1350  turn.  This 
limited  data  serves  to  indicate  that  this  type  of  procedural  delay  can  be  performed 
using  a minimum  capability  RNAV  system.  Before  examining  the  eight  flight  pro- 
files using  "Direct  To"  procedures,  it  is  interesting  to  note  the  cockpit  work- 
load required  to  perform  this  maneuver  procedural ly. 

Normal  RNAV  procedures  using  a single  waypoint  RNAV  system  would  be  to 
immediately  refer  to  the  SID  or  STAR  chart  upon  receiving  a Direct  To  command 
in  order  to  locate  the  waypoint  and  orient  the  aircraft's  present  position  with 
respect  to  the  desired  waypoint.  This  process  allows  the  pilot  to  determine  an 
approximate  heading  change  required  to  implement  the  ATC  requested  Direct  To 
maneuver.  The  pilot  would  then  normally  roll  into  a standard  rate  turn  and  con- 
tinue the  turn  to  the  approximate  heading  determined  from  examination  of  the 
chart.  At  this  time  or  even  at  some  point  during  the  turn  the  pilot  would  up- 
date the  RNAV  (p  ,0)  inputs  to  those  of  the  waypoint  specified  by  ATC.  Upon 
completion  of  the  turn  and  the  update,  the  pilot  would  then  rotate  the  desired 
course  setting  knob  on  the  omnibearing  selector  (OBS)  until  the  cross  track 
deviation  indicator  (CDI)  shows  an  on  course  indication  (centered  position).  This 
OBS  course,  along  with  the  specified  (p  , 6)  inputs,  provides  enough  information 
to  the  computer  to  derive  desired  course  information.  The  pilot  will  then  follow 
subsequent  CDI  deflections  and  maintain  a centered  indication  until  additional 
instructions  are  received  or  until  the  waypoint  specified  has  been  reached.  The 
only  real  difference  between  the  input  for  a Direct  To  and  a pre-defined  route 
segment  is  that  the  knowledge  of  desired  course  must  be  defined  by  trial  and 
error  after  (p  , O)  update  in  the  case  of  the  Direct  To  while  outbound  course 
is  generally  a known,  charted  input  parameter  on  pre-planned  routes. 

The  use  of  the  Direct  To  for  path  stretching  and  shortening  was  obviously 
an  integral  element  in  the  development  of_RNAV  STARs  in  the  Miami  terminal  area. 
Figure  3.47  is  a reproduction  of  published  arrival  routes  to  runways  9L  and  27R 
in  Miami.  This  arrival  is  called  the  PIKE  ONE  RNAV  ARRIVAL.  Transitions  to 
runway  9L  are  via  CLUB  waypoint  and  transitions  to  runway  27R  are  via  FISHER 
waypoint.  The  route  flown  in  the  operational  evaluation  was  the  CLUB  transition 
since  this  is  the  predominant  traffic  flow  in  the  Miami  area.  This  particular 
transition  is  characterized  by  a series  of  waypoints  located  in  line  on  both 
the  base  leg  (WILSON,  CLUB,  FROG)  and  the  final  approach  leg  (KROME,  COOPER, 
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3.47  PIKE  ONE  RNAV  ARRIVAL 


PORTLAND).  The  relative  position  of  these  in  line  waypoints  in  a north/south 
sense  allows  utilization  of  many  combinations  of  aircraft  path  shortening  and 
lengthening  without  the  use  of  vectors.  The  charting  of  these  conveniently 
located  waypoints  provides  excellent  orientation  information  to  the  pilot. 

Figure  3.48  shows  a series  of  3 flights  on  which  the  test  aircraft  exe- 
cuted direct  to  COOPER  waypoint  maneuvers.  On  two  of  these  flights  the  safety 
pilot  requested  path  shortening  by  a direct  to  COOPER  via  CLUB  maneuver.  This 
request  was  acceptable  to  ATC  and  the  resulting  tracks  are  shown.  On  a later 
test  flight,  the  controller  requested  a direct  to  COOPER  maneuver  when  the  air- 
craft DME  indicator  showed  approximately  2.0  nm  distance  to  CLUB  waypoint.  The 
slight  difference  in  the  clearances  did  not  affect  the  overall  accuracy  with 
which  each  of  the  three  flights  proceeded  to  COOPER  waypoint.  In  fact,  using 
the  input  procedure  described  earlier,  all  three  flights  were  well  within  the 
current  '2.0  nm  terminal  area  airspace  limits  (Handbook  7110.18  [7]). 

It  is  significant  to  note  the  path  shortening  effect  of  these  three  "Direct 
To"  maneuvers.  The  direct  to  COOPER  via  CLUB  flights  shortened  the  required 
terminal  area  maneuvering  route  length  by  about  8 or  9 nautical  miles  and  the 
remaining  flight  by  about  10  nm.  This  distance  decrease  corresponds  to  4 to  5 
minutes  at  120  knots  and  about  3 minutes  at  180  knots. 

One  final  point  regarding  this  procedure  is  that  the  pilot  workload  was 
considered  quite  acceptable.  However,  as  previously  stated,  the  successful 
aircraft  tracks  shown  in  the  figure  require  a high  degree  of  pilot  orientation 
to  desired  track  and  a high  degree  of  RNAV  training. 

Figure  3.49  shows  another  RNAV  arrival  route  used  for  arrivals  into  Miami. 
This  STAR  is  called  the  NEW  RIVER  ONE  RNAV  ARRIVAL.  The  primary  transition 
tested  was  the  FROG  transition  to  runway  9L.  This  route  has  the  options  of  in- 
tercepting the  final  approach  course  at  COOPER  nr  PORTLAND  waypoints.  Note  also 
that  the  BAKER  transition  to  runway  27R  shows  the  same  series  of  charted  way- 
points  available  for  path  shortening  as  the  PIKE/FROG  route. 

Only  one  direct  to  PORTLAND  instruction  was  flown  using  the  NEW  RIVER  STAR. 
The  results  of  this  track  are  shown  in  Figure  3.50.  The  shallow  turn  angles 
involved  and  the  longer  track  length  produced  an  even  more  accurate  "Direct  To" 
track  than  for  the  previously  discussed  data.  Approximately  13  route  miles 
were  saved  by  this  maneuver. 

Two  additional  direct  to  PORTLAND  flights  are  also  illustrated  in  Figure 
3.50.  Once  again,  the  somewhat  atypical  clearance  to  proceed  direct  to  PORTLAND 
via  CLUB  was  used  when  the  safety  pilot  requested  this  route.  This  was  necessary 
for  test  flight  coordination  with  ATC.  Both  aircraft  profiles  stayed  within 
one  nautical  mile  of  the  precise  track  defined  by  connecting  CLUB  to  PORTLAND. 
Approximately  12  route  miles  were  saved  by  this  maneuver. 

Although  other  routes  were  tested  in  Denver,  the  only  "Direct  To"  data  was 
obtained  on  the  TRAIL  ONE  RNAV  ARRIVAL  shown  in  Figure  3.51.  Two  ATC  requests 
for  "Direct  To"  maneuvers  were  received  to  expedite  traffic  flow  on  the  BYERS 
to  FRED  route  segment.  These  two  maneuvers  were  necessary  to  allow  higher  speed 
aircraft  to  pass  the  test  aircraft  since  the  BYERS  to  FRED  route  segment  was 
also  used  for  a straight-in  approach  to  runway  26L.  Both  of  the  "Direct  To" 
maneuvers  tested  resulted  in  slightly  shorter  paths.  One  request  was  for  a 
"Direct  To"  to  GOLF  and  the  other  was  for  a "Direct  To"  to  PINE. 
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Figure  3.50  A.C. 500/KIiJG  FLIGHT  TEST  RESULTS:  DIRECT  TO  PORTLAND 
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Figure  3.51  TRAIl  OiiE  RNAV  ARRIVAL,  GOLF  TRAflSITIO:i , DENVER  TERMINAL  AREA 


Figure  3.52  shows  an  aircraft  track  (radar)  and  an  RNAV  indicated  position 
trace  for  a direct  to  GOLF  maneuver.  This  ATC  request  was  given  when  the  dis- 
tance to  FRED  waypoint  was  13.0  nm.  The  pilot  procedures  described  previously 
were  used  to  accomplish  this  maneuver.  The  speed  with  which  centering  the  OBS 
needle  was  achieved  can  be  seen  by  noting  the  intersection  of  the  dotted  line 
(GDI)  and  the  dashed  line  (desired  OBS  course).  Once  the  GDI  was  centered,  the 
FTE  for  the  remainder  of  the  maneuver  was  quite  negligible.  The  rather  large 
difference  (approximately  1.5  nm)  between  the  RNAV  indicated  position  and  the 
radar  position  is  not  typical.  However,  the  convergence  of  this  difference  to 
less  than  0.5  nm  as  the  waypoint  in  use  is  approached  has  been  noted  on  all  test 
flights.  In  spite  of  this  large  RNAV  system  error  or  indicated  position  discre- 
pancy at  the  start  of  the  "Di rect  Td' maneuver , the  gross  result  was  acceptable, 
to  ATG.  Only  a minor  3.0  nm  distance  savings  was  achieved  with  this  procedure. 
However,  the  pilot  expressed  satisfaction  with  the  lower  input  workload  especially 
when  comparing  the  input  to  the  5.0  nm  base  leg  from  PINE  to  GOLF. 

Figure  3.53  shows  the  last  Direct  To  maneuver.  This  case  was  a direct 
to  PINE  request  issued  by  ATC  when  the  aircraft  was  approximately  6.0  nm  from 
FRED  waypoint.  This  particular  maneuver  only  saved  2.0  nm  track  distance  but 
did  provide  the  desired  traffic  spacing  on  the  BYERS  to  FRED  segment.  This 
radar  track  also  shows  the  very  rapid  response  to  the  ATC  request  indicated  by 
the  approximate  45°  heading  change  less  than  1.0  nm  along  track  after  the 
Direct  To  was  requested.  As  shown  on  the  previous  plot  (Figure  3.52),  a pre- 
ferable maneuver  from  both  distance  saved  and  a reduced  pilot  workload  view- 
point was  the  direct  to  GOLF  which  eliminates  the  need  for  RNAV  input  on  the 
short  5 nm  base  leg  (PINE  to  GOLF). 

To  summarize,  the  Task  Force  concepts  of  the  Delay  Fan  and  "Direct  To"  pro- 
cedures have  been  evaluated  both  experimentally  and  in  operational  environments. 
The  experimental  evaluation  utilized  an  airline  RNAV  system  and  consisted  of  six 
flight  profiles,  two  were  manual  flights  and  four  were  flown  in  the  autopilot 
coupled  mode.  The  manual  Delay  Fan  traces  demonstrated  that  the  functional  capa- 
bility is  acceptable  insofar  as  achieving  the  desired  45°  intercept  course  to  the 
parallel  offset.  However,  pilot  procedures  must  stress  the  necessity  to  initiate 
the  45°  headi ng  change  precisely  when  specified  by  the  air  traffic  controller. 

The  four  auto^lot  coupled  Delay  Fans  illustrated  potential  blunders  associated 
with  pi lot-RNAV-autopi lot  control  as  well  as  possible  RNAV  software  incompat- 
abilities  with  operational  requirements  such  as  the  Delay  Fan.  The  operational 
evaluation  consisted  of  2 Delay  Fans  and  8 Direct  To  procedures.  All  of  these 
flights  were  with  a general  aviation  RNAV  system.  These  flights  demonstrated 
the  functional  capability  of  this  level  of  RNAV  system  to  perform  these  maneuvers. 
The  successful  utilization  of  this  functional  capability  is,  however,  strongly 
dependent  on  pilot  familiarity  and  training  in  area  navigation  procedures.  ATG 
compatibility  was  substantiated  by  the  acceptable  aircraft  response  and  airspace 
utilization.  Finally,  pilot  workload  was  judged  acceptable  during  these  impromptu 
maneuvers . 
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3.5  WAYPOINT  STORAGE  EFFECTS  ON  FTE 


A detailed  description  of  the  cockpit  simulator  experiment  was  presented 
in  Section  3.2  showing  the  route  flown  and  the  areas  investigating  parallel 
offset  capability.  In  addition.  Section  3.3  explained  the  ooeration  of 
the  RNAV  control  display  unit.  This  unit  was  pictured  in  Figure  3.36.  The 
purpose  of  this  present  discussion  is  to  present  the  results  of  the  cockpit 
simulator  experiment  regarding  the  effects  of  varying  waypoint  storage  capa- 
bility on  FTE. 

The  interest  in  the  impact  of  waypoint  storage  capacity  on  FTE  was  gener- 
ated by  the  Task  Force  supposition  that  a minimum  requirement  for  more  than  one 
waypoint  existed.  In  fact,  the  Task  Force  stated  that  RNAV  equipment  must  have: 

"Capability  for  simple  manual  insertion  of  waypoints  which  will 
not  impose  an  excessive  pilot  workload.  In  addition,  the  equip- 
ment must  have  a capability  to  store  at  least  6 waypoints,  except 
for  aircraft  with  VNAV  capability  the  equipment  must  have  suf- 
ficient storage  to  provide  for  10  waypoints.  The  pilot  must  be 
able  to  make  impromptu  selection  of  stored  waypoints  and  to  man- 
ually select  a different  waypoint  without  disturbing  the  stored 
data . " 

This  statement  was  excerpted  from  Section  IV  E (of  the  Task  Force  Report) 
Minimum  Operational  Characteristics.  The  precise  requirement  for  storing  6 or 
10  waypoints  was  not  analytically  or  empirically  derived.  Rather,  the  specifi- 
cation was  based  ot.  the  general  "feeling"  of  the  Task  Force  that  terminal  area 
arrival  and  departure  routes  would  generally  be  composed  of  about  6 waypoints 
for  the  2D  case  and  10  for  3D  if  the  basic  Task  Force  recommended  wagon  wheel 
terminal  area  design  concept  was  used. 

Since  the  publication  of  the  Task  Force  Report  [2],  a considerable  amount 
of  research  and  testing  has  been  completed.  The  terminal  area  design  work  [12] 
has  shown  that  modifications  to  the  basic  wagon  wheel  concept  are  routinely 
necessary  which  consider  the  unique  traffic,  terrain  and  controller  procedures 
associated  with  each  specific  terminal  area.  Similarly,  the  preliminary  con- 
sideration of  avionics  standards  [8]  has  involved  analysis  of  available  cockpit 
simulator  and  flight  test  data  regarding  waypoint  storage  standards.  Table  3.28 
summarizes  the  data  from  that  preliminary  avionics  standards  document. 

Data  was  evaluated  from  three  previous  experiments;  the  General  Aviation 
Flight  Test  program  defined  in  Anpendix  A of  Reference  8,  from  the  University 
of  Illinois  simulator  program  [13]  and  from  the  University  of  Illinois  flight 
test  [14]  of  a two  waypoint  analog  general  aviation  RNAV  system. 

The  precise  requirement  for  6 waypoints  (specified  in  the  Task  Force  Report) 
as  the  minimum  number  was  not  verified  either  from  a workload  reduction  viewpoint 
or  for  the  effects  on  the  accuracy  with  which  pilots  can  navigate.  This  document 
stated  that  "The  minimum  acceptable  waypoint  storage  requirements  can  only  be  es- 
tablished in  actual  flight  tests  and/or  cockpit  simulations  utilizing  the  stan- 
dardized procedures  and  route  design  concepts  of  the  Task  Force  Report."  The 
recent  cockpit  simulator  evaluation  of  1 , 2 and  3 waypoint  storage  capability 
was  in  response  to  both  the  Task  Force  postulation  and  the  avionics  standards 
recommendation . 
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TABLE  3.28  WAYPOINT  STORAGE  REQUIREMENTS 


DATA  SOURCE 

EVALUATION  CRITERIA 

Accuracy 

Operational 
Acceptabi 1 i ty 

Workload 

General  Aviation  Flight  Test 
(Single  Waypoint  System) 

Acceptable 

Acceptable 

Unacceptable 

University  of  Illinois 
(2  waypoint  system) 
Flight  Test 

Not  Evaluated 
(No  Radar 
Tracking) 

Acceptable 

Acceptable 

Cockpit  Simulation 
Low  Workload 

Not  Evaluated 

1 not  acceptable 

1 not  acceptable 

Side  Task  Loading 

Not  Evaluated 

4 or  less 
unacceptable 

4 or  less 
unacceptable 

The  precise  requirements  for  the  storage  of  area  navigation  waypoints  were 
evaluated  from  three  points  of  view  in  the  avionics  standards  document; 

1)  The  impact  on  flight  path  accuracy  as  indicated  by  total  system 
cross  track  error  (TSCT) . 

2)  The  operational  ability  and/or  problems  in  performing  Task  Force 
suggested  routes  and  procedures  within  acceptable  FTE  limits. 

3)  The  relationship  to  pilot  workload. 


To  fully  understand  the  following  presentation  of  the  cockpit  simulator 
results,  reference  should  be  made  to  Table  3.18  of  Section  3.2  which  details  I 

the  experimental  test  matrix.  To  summarize,  the  major  test  variables  were  3 1 

levels  of  waypoint  storage,  2 types  of  turn  anticipation  and  2 levels  of  par- 
allel offset  tracks  in  addition  to  centerline  tracking.  The  data  taken  during 

this  experiment  included  digital  recording  of  FTE  and  manual  recording  of  sub-  ■* 

ject  pilot  mistakes  or  blunders.  Data  reduction  included  aggregation  of  statis- 
tical FTE  results  across  flights  and  sorting  these  results  by  major  test  vari- 
able categories.  Additional  data  analysis  was  aimed  at  assessing  the  relative 
acceptability  of  1 , 2 or  3 stored  waypoints  from  a blunder  analysis,  which  is 
reprc  itative  of  system  complexity  effects  on  pilot  workload.  The  results  of 
both  L ta  reduction  efforts  are  presented  in  the  following  paragraphs. 

Table  3.29  presents  the  overview  of  the  cockpit  simulator  waypoint  storage 
variation  experiment.  Both  mean  or  bias  errors  and  two  sigma  FTE  variability 
errors  are  shown.  No  significant  bias  errors  were  measured  in  any  of  the  way- 
point  storage  categories  for  the  various  statistical  aggregations  listed.  The 
particular  categories  shown  include: 
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TABLE  3.29  UNIVERSITY  OF  ILLINOIS  LATERAL  FTE  STATISTICAL  MATRIX 


A Negative,  " - ",  means  error  to  the  right  of  course 
(fly  left  CDl  Command) 


• 

Route  Summary  FTE  statistics 

Total 

fBias  * two-sigma  in  nm) 

Iwp 

2wp 

3wp 

Aggregate 

SID  & STAR  (Steady  State) 
(Seg  2,  4,  5,  6,  7) 

-.057±.322 

-.033i.356 

-,035i.498 

-.042*. 400 

SID  & STAR  (Turns  Included) 

-.065±.52 

-.029* .450 

-.032+. 612 

-.043i.532 

• 

SID  & STAR  Comparison 

Steady  State  SID 

-.055*..  272 

-.026i.248 

-.0051.524 

-.029+. 370 

STAR 

-.067±.378 

-.044+. 444 

-.060+. 494 

-.060+. 442 

Turns  Included,  SID 

-.057±.434 

-.01 8.+  . 384 

.006 +.820 

-.0241.578 

STAR 

-.055i.600 

-.023+. 550 

-.0321.596 

-.037+. 584 

• 

Final  Approach 

Last  3 nm  Seg  9 

-.038+.304 

-.037+. 258 

-.0291.326 

-.035+. 298 

Lateral  FTE  during  30 
(Seg  8 & 9) 

.022i.522 

-.035t.520 

.05+. 530 

.0361.524 

• Route  Summary  FTE  Statistics  - data  from  all  segments  of  the  route 
tested  except  base  leg  and  final  approach. 

• SID  & STAR  Comparison  - data  aggregated  by  departure  and  arrival 
segments . 

• Final  Approach  - data  for  the  last  3 nm  of  the  final  approach  segment 
(9)  and  data  for  the  descent  on  base  leg  and  final  approach. 

Scanning  this  table  comparing  the  1 wp,  2 wp  and  3 wp  columns  shows  that 
no  significant  differences  occurred  in  any  of  the  waypoint  categories  as  far 
as  FTE  reduction  or  inflation  is  concerned.  In  addition,  it  should  be  noted 
that  both  steady  state  data  and  FTE  including  turn  data  were  presented.  This 
was  done  specifically  to  indicate  that  steady  state  editing  did  not  affect  the 
conclusion  that  1,  2 and  3 waypoint  storage  capability  had  no  appreciable  im- 
pact on  measured  FTE.  This  conclusion  substantiates  the  conclusion  of  the 
avionics  standards  study  [8]  that  a single  waypoint  system  was  acceptable  from 
an  overall  accuracy  viewpoint  as  well  as  from  the  operational  capability  to 
perform  successfully  in  the  terminal  area.  Although  these  overall  results  in- 
dicate no  appreciable  change  in  FTE  as  a function  of  waypoint  storage,  it  was 
felt  that  simple  statistical  aggregation  and  analysis  of  the  aggregates  by 
category  did  not  provide  a comprehens i ve  enough  picture.  Therefore,  the  Uni- 
versity of  Illinois  performed  a detailed  analysis  of  variance  on  the  same  set 
of  data.  This  analysis  included  a somewhat  different  statistical  data  combin- 
ation technique  and  generally  led  to  somewhat  smaller  two  sigma  FTE  values.  The 
detailed  analysis  is  presented  in  Appendix  A.  However,  Figures  3.54  3.55  and 
3.56  are  included  in  this  section  to  summarize  the  analysis  of  variance  on  the 
transition,  base  leg  and  final  approach  route  segments.  All  data  plotted  on  these 
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Figure  3.55  BASE  LEG/WAYPOINT  STORAGE  COMPARISON 
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figures  is  2 sigma  variability  of  horizontal  steering  error  in  nautical  miles. 

The  data  is  for  steady  state  performance  only.  The  FTE  data  is  plotted  as  a 
function  of  waypoint  storage  and  subdivided  by  centerline,  3 nm  and  5 nm  offsets. 

Each  categorized  plot  includes  a brief  description  of  the  data.  It  should 
be  noted  that  this  somewhat  qualitative  presentation  is  substantiated  by  a de- 
tailed statistical  treatment  in  Appendix  A.  The  conclusions  of  both  levels  of 
analysis  were  the  same,  that  is,  no  overall  reliable  differences  in  FTE  were 
shown  due  to  the  dj fferent  levels  of  waypoint  storage  tested . 

In  order  to  assess  the  effects  of  waypoint  storage  on  the  more  qualitative 
aspects  of  the  area  navigation  task  and  of  pilot  workload  in  general,  navigation 
procedural  errors  were  recorded  manually  on  the  observer  checklist  by  the  safety 
pilot  when  it  became  evident  that  the  subject  pilot  was  not  aware  of  the  error 
and  would  not  make  a correction.  To  prevent  loss  of  meaningful  recorded  data, 
no  long  delays  in  correcting  procedural  errors  were  allowed. 

At  this  point  two  definitions  may  help  clarify  the  classification  of  pro- 
cedural errors.  First,  a procedural  error  is  defined  as  any  navigation  control 
setting  or  aircraft  control  error  which,  if  allowed  to  continue  uncorrected, 
would  result  in  a significant  deviation  from  the  assigned  route  of  flight. 

Second,  a blunder  is  defined  as  a procedural  error  which  resulted  in  a deviation 
from  ATC  assigned  and  protected  airspace. 


Incorrect  settings  or  responses  of  the  following  workload  related  items 
were  classified  as  procedural  errors; 


RNAV  Input 


Pilot  Procedure 


Waypoint  set 

Waypoint  in  use 

Radial 

Frequency 

Distance 

Course 

Offset 

Altitude 

G1 ideslope 

Set  Anticipation 

Enter 

Confi rm 


Information  entered  at  wrong  time 
Ignored  Anticipation  light 
Turned  to  wrong  heading 
Voice  Communication 
Transponder 

Communication  Frequency 


The  results  of  the  analysis  of  all  the  blunder  data  recorded  during  this 
evaluation  of  waypoint  storage  are  presented  in  Figure  3.57.  The  data  on  this 
figure  is  divided  according  to  the  type  of  turn  anticipation  technique  used. 
This  analysis  of  pilot  errors  clearly  shows  that  a significant  reduction  in 
blunders  occurred  for  both  types  of  turn  anticipation  with  a two  waypoint  sys- 
tem. There  was  a 30-34  improvement  over  a single  waypoint  system  depending 
on  turn  anticipation  technique  and  a 29-67  improvement  over  a three  waypoint 
system.  The  meaning  and  impact  of  this  type  of  cockpit  workload  or  blunder 
potential  analysis  is  not  easily  quantifiable.  However,  the  current  simulator 
experiment  again  substantiates  the  conclusion  in  the  avionics  standards  docu- 
ment [8]  that:  "The  conclusion  based  on  the  available  data  is  that  a single 
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waypoint  storage  capability  appears  inadequate  for  high  workload  envi roninents 
such  as  high  density  terminal  areas.  However,  a single  waypoint  appears  ade- 
quate in  low  workload  envi ronmenub , such  as  enroute." 


I It  is  unfortunate  that  the  blunder  potential  was  not  statistically  evident 

j in  the  FTE  analysis.  Several  reasons  could  be  suggested  to  rationalize  this 

occurrence.  Such  items  as  the  controlled  environment  of  the  simulator,  the  a 
priori  knowledge  that  blunders  would  not  have  catastrophic  consequences,  the 
1 ease  of  maintaining  heading  and  altitude  control  in  the  simulator  with  zero 

wind  and  zero  turbulence  all  impact  the  pilot's  technique  and  the  measured  FTE. 
However,  two  points  tend  to  reinforce  confidence  in  the  most  recent  simulator 
results.  First  of  all,  -eferring  again  to  Section  3.1.7  where  the  simulator 
data  adjustment  factor  was  developed  and  using  this  multiplier  factor  on  the 
single  and  dual  waypoint  two  sigma  data  from  Table  3.29,  reasonable  agreement 
between  the  adjusted  simulator  FTE  and  the  flight  test  results  for  a single  way- 
point system  (see  Table  3.30)  and  excellent  agreement  for  a 2 waypoint  system 
are  evident.  The  flight  test  results  are  repeated  from  Section  3.1,  Table  3.3. 


TABLE  3.30  STEADY  STATE  COCKPIT  SIMULATOR  FTE  COMPARED  TO 
FLIGHT  TEST  RESULTS  FOR  SINGLE  AND  DUAL  WAYPOINT 
STORAGE  CAPACITY 


Sigma 

FTE  (nm) 

Data  Source 

1 wp* 

2 wp** 

0.76 

0.71 

GAT  2/Minicomputer  experiment  (adjusted) 

1.05 

-- 

A. C. 500/King  Single  wp  Flight  Test 

-- 

0.76 

G-l/Butler  Two  wp  Flight  Test 

-- 

0.95 

Twin  Beech/Butler  Two  wp  Flight  Test 

* STAR  data  only  on  both  Flight  Test  and  Simulator 
**  SID  and  STAR  data  on  both  Flight  Test  and  Simulator 


Secondly,  and  probably  more  significant,  is  that  the  blunder  analysis  sub- 
stantiates the  flight  test  results  quoted  in  the  avionics  standards  reference 
[8]  in  which  by  utilizing  workload  as  a criteria  for  waypoint  storage  evaluation 
it  was  concluded  that  a single  waypoint  system  was  not  acceptable.  The  subject 
pilots  in  general  disapproved  of  the  jiigh  workload  involved  in  flying  a system 
requiring  continuous  waypoint  input  and  verification.  The  difficulty  of  picking 
out  the  correct  waypoint  input  information  from  the  chart  in  the  high  workload 
environment  was  also  considered  unacceptable.  This  workload  was  judged  unaccept- 
able from  a minimum  functional  recjuirement  viewpoint  for  high  density  terminal 
area  operations.  This  conclusion  was  also  reached  in  the  terminal  area  3D  and 
40  area  navigation  study  [15]. 
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To  summarize  what  has  been  said,  both  the  current  cockpit  simulator  study 
and  the  preliminary  avionics  standards  document  support  the  fact  that  from  an 
accuracy  (FTE  and  TSCT)  and  a functional  viewpoint,  no  reliable  differences  can 
be  measured  for  1,  2 or  3 waypoint  storage  capability.  However,  both  the  flight 
tests  performed  to  date  and  the  workload/blunder  data  from  the  simulator  tests 
performed  indicate  that  terminal  area  workload  is  too  high  for  a single  waypoint 
system  to  be  acceptable.  In  fact,  the  simulator  workload/blunder  results  indi- 
cate that  a 2 waypoint  system  is  preferable  to  a 1 or  3 waypoint  system  for 
terminal  area  operations. 
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3.6  AIRSPACE  UTILIZATION  AND  ACCURACY 


A study  of  flight  technical  error  must  include  a description  of  the  impact 
of  this  error  component  on  the  actual  flight  path  of  the  aircraft.  The  assess- 
ment of  the  enroute,  terminal  and  approach  airspace  required  to  accommodate  an 
area  navigation  equipped  aircraft,  which  inherently  includes  flight  technical 
error,  is  necessary  for  airspace  planning,  developing  RNAV  procedures  and  design 
ing  RNAV  systems.  As  stated  in  the  recently  published  FAA  Advisory  Circular 
AC90-45A  [1],  Total  System  Error  is  used  by  airspace  planners  and  includes  spe- 
cific FTE  values  for  determining  cross  track  position  accuracies.  The  impact  of 
FTE  on  Total  System  Error  is  assessed  quantitatively  by  measuring  aircraft  posi- 
tion using  tracking  radar  while  simultaneously  recording  airborne  indicated 
RNAV  position  (FTE  measured  by  CDI  deflections). 

Total  System  Cross  Track  (TSCT)  error  is  the  lateral  difference  between 
radar  indicated  aircraft  position  and  the  desired  RNAV  route.  Total  System 
Cross  Track  error  is  the  quantity  used  as  a direct  measure  of  airspace  utili- 
zation and  accurately  defines  overall  RNAV  system  performance  including  FTE. 

TSCT  error  measurement  provides  a standard  for  use  by  the  airspace  planner  as 
an  accurate  estimate  of  area  navigation  airspace  utilization.  This  standard 
inherently  includes  FTE.  The  purpose  of  this  section  is  to  provide  the  airspace 
planner  with  this  accurate  estimate  to  be  used  in  conjunction  with  the  FTE  mag- 
nitudes already  established  as  part  of  this  analysis  in  Section  3.1.  Table  3.3 
of  that  section  should  be  used  in  conjunction  with  the  results  presented  in  this 
section.  This  dual  set  of  measured  TSCT  and  FTE  errors  presents  a quantitative 
accuracy  standard  for  a wide  variety  of  RNAV  system  for  enroute,  terminal  and 
approach  airspace  planning. 

3.6.1  O^veral  1_ D^ta  Summary 

Just  as  in  the  case  of  FTE,  the  current  TSCT  accuracy  limits  are  defined 
in  Appendix  A of  AC90-45A  [1].  In  addition,  the  Task  Force  Report  [2]  antici- 
pated a need  for  improved  system  accuracies  as  RNAV  implementation  progressed 
and  the  number  of  RNAV  equipped  aircraft  became  significant  in  relation  to  con- 
ventional VOR/DME  equipped  aircraft.  The  current  accuracy  limits,  the  Task 
Force  limits  and  a summary  of  all  available  TSCT  performance  data  is  presented 
in  Tables  3.31  and  3.32.  The  first  of  these  tables  presents  two  sigma  data  and 
the  second  presents  the  mean  error  or  central  tendency  of  the  two  sigma  data. 

The  enroute  data  was  obtained  from  tests  of  the  Delco,  Litton,  Butler  and 
King  RNAV  systems.  This  data  demonstrated  that  a total  system  accuracy  of 
■1.10  nm  was  achievable.  Results  for  the  enroute  airspace  indicate  that  both 
AC  90-45A  and  current  Task  Force  limits  can  be  met.  In  addition,  the  more  strin 
gent  Task  Force  limits  for  Phase  2 and  Phase  3 appear  achievable.  The  enroute 
DC-lO/Delco  data  was  taken  primarily  between  Denver  and  Chicago  in  the  high 
altitude  route  structure.  The  Litton,  Butler  and  King  data  was  taken  in  the 
low  altitude  route  structure  at  altitudes  of  17,000,  8,000  and  5,000  feet  re- 
spectively. The  worst  case  results  provide  additional  insight  into  enroute 
accuracy  capabilities.  The  worst  case  total  system  performance  measured  during 
the  King  manual  flights  was  only  ‘2.23  nm  indicating  that  current  data  was 
well  within  the  *4.0  nm  specified  enroute  accuracy  tolerances.  A route  by 
route  summary  of  the  Delco  data  is  shown  in  Table  3.33  for  individual  assess- 
ment by  the  reader.  This  is  followed  by  a more  detailed  presentation  of  the 
enroute  data  on  the  other  three  systems. 


TABLE  3.31  TOTAL  SYSTEM  ACCURACY  - TWO  SIGMA  DATA 
(Zero  Mean  Assumed,  VOR/DME  Except  as  Noted) 


Number 

Flight 

of 

Two-Sigma 

Data  Source 

Phase 

Flights 

TSCT-nm 

Comments 

Task  Force  Report 

Enroute 

- - 

4. 0/4. 0/2. 5 

Phase  1 

DC-lO/Delco  - Manual 

5 

0.55 

(splay)/Phase  2/Phase  3 

- Autopilot 

9 

0.86 

[See  AC90-45A 

727/Litton  (NAFEC) 

Appendix  A,  Sections 

Inertial  manual  updating 

13 

0.75 

A. 2. a (1),  A.2.a(2)  and 

Inertial  automatic  updating 

10 

0.60 

A. 2. a. (3)  for  current  > 

G-l/Butler  (NAFEC) 

45 

0.98 

limits] 

A. C. 500/ King  (NAFEC) 

5 

2.23 

1 

All  Systems  Combined 

1 

87 

1.10 

Task  Force  Report 

Terminal 

2.0/1 .5/1 .5 

Phase  1/Phase  2/Phase  3 

DC-lO/Delco  - Autopilot  (ORD) 

12 

1.12 

[See  AC90-45A 

- Autopilot  (DEN) 

2 

0.38 

Appendix  A,  sections 

727/Litton  (NAFEC) 

noted  above  for  current 

Inertial  manual  updating 

13 

0.75 

1 imi ts] 

Inertial  automatic  updating 
G-l/Collins  (NAFEC) 

10 

0.66 

DME/DME  manual 

14 

0.38 

DME/DME  autopilot 

14 

0.31 

VOR/DME  manual 

7 

0.59 

VOR/DME  autopilot 

8 

0.48 

VOR/DME/VOR/OME  autopilot 

7 

0.30 

A. C. 500/King  (DEN  & MIA) 

37 

0.96 

' 

G-l/Butler  (NAFEC) 

45 

1.19 

A. C. 500/King  (NAFEC) 

30 

1.50 

All  Systems  Combined 

1 

199 

1.04 

Task  Force  Report 

Approach 

_ _ 

0.9/0. 8/0. 6 

Phase  1/Phase  2/Phase  3 [ 

G-1 /Coll  ins  (DME/DME) 

28 

0.25 

[AC90-45A-0.6  nmj 

A.  C. 500/ King 

32 

0.47 

♦0.25  nm/dot 

All  Systems  Combined 

1 

' 

60 

0.58 

I 

- . . --  - ’ 
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Data  Source 

FI  ight 
Phase 

Number 

of 

FI  ights 

Mean 

NM 

Comments 

Task  Force  Report 

Enroute 

DC-IO/DELCO-  Manual 

5 

0.38L 

Inertial  Reference 

- Autopilot 

9 

0.32L 

Inertial  Reference 

727/LITTON  (NAFEC) 

Inertial  Manual  Updating 

13 

O.llL 

Tracking  Radar 

Inertial  Automatic 

Updating 

10 

0.12L 

Tracking  Radar 

G-l/BUTLER  (NAFEC) 

45 

0.34R 

Tracking  Radar 

A.C.  500/KING  (NAFEC) 

5 

O.IOR 

Tracking  Radar 

All  Systems  Combined 

] 

f 

...  87 

O.IOR 

Task  Force  Report 

Terminal 

r 

DC-IO/DELCO-  Autopilot  (ORD) 

12 

0.53L 

Arts  III 

- Autopilot  (DEN) 

2 

0.57L 

Arts  III 

727/LITTON  (NAFEC) 

Inertial  Manual  Updating 

13 

0.03R 

Tracking  Radar 

Inertial  Automatic 

Updating 

10 

O.OIR 

Tracking  Radar 

G-l/COLLINS  (NAFEC) 

DME/DME  Manual 

14 

0.06R 

Tracking  Radar 

DME/DME  Autopilot 

14 

Q.02L 

Tracking  Radar 

VOR/DME  Manual 

7 

0.12R 

Tracking  Radar 

VOR/DME  Autopilot 

8 

0.08R 

Tracking  Radar 

VOR/DME/VOR/DME  Autopilot 

7 

0.02L 

Tracking  Radar 

A.C.  500/KING  (DEN  & MIA) 

37 

0.  20L 

Arts  III 

G-l/BUTLER  (NAFEC) 

45 

0.03R 

Tracking  Radar 

A.C.  500/KING  (NAFEC) 

30 

0.08L 

Tracking  Radar 

All  Systems  Combined 

1 

199 

0.07L 

Task  Force  Report 

Approach 

G-l/COLLINS  (DME/DME) 

28 

0.13R 

Tracking  Radar 

A.C.  500/KING 

32 

0.31L 

Tracking  Radar 

All  Systems  Combined 

60 

O.llL 

... 

■ ^ ; 

- 

i 

■ 

[ 

t 
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TABLE  3.33  ENROUTE  MANUAL  vs.  AUTOPILOT  TSCl  - OPERATIONAL  RESULTS 

(VOR/DME  Mode;  Charted  Reference  Facility) 


Departure  - 
Destination 

Manual  TSCT 
Mean  ± two-sigma 
(nm) 

Autopilot  TSCT 
Mean  ± two-sigma 
(nm) 

SFO  - DEN  (Ascent) 

.02L+1 .56 

SFO  - DEN  (Descent) 

.llRtl  08 

-- 

ORD  - DEN  (Level) 

.43L+0.72 

.26R±1.00 

ORD  - DEN 

-- 

.16R+1.22 

ORD  - DEN 

— 

.OlLiO.90 

ORD  - OEN 

— 

.63L±0.58 

LAX  - ORD 

.30L10.40 

-- 

LAX  - ORD 

1 .17L±0.62 

LAX  - ORD 

.06L+0.64 

— 

DEN  - ORD 

— 

.231.  ±0.67 

DEN  - ORD 

-- 

.22R±0.96 

DEN  - ORD 

-- 

.19R±1.02 

DEN  - ORD 

1.35L±1.72 

DEN  - ORD 

1 .46L±2.09 

Continuing  with  the  analysis  of  the  data  summarized  in  Table  3.31,  the 
terminal  area  grand  aggregation  for  199  flights  showed  an  achievable  accuracy 
of  >1.04  nm  two  sigma.  This  is  a reliable  95%  probability  number  with  a confi-  * 

dence  interval  of  ±0.10  nm  based  on  a large  number  of  flights  for  the  six  RNAV 
system  and  aircraft  combinations  listed.  These  results  are  also  well  within  * 

current  and  anticipated  route  width  requirements  for  the  terminal  area.  Al-  < 

though  combining  data  from  diverse  system  types  which  flew  under  varying  traf- 
fic mix  conditions  and  using  different  routes  is  not  conventional  experimental  • 

data  analysis  practice,  this  combination  is  meaningful  for  overall  system  impact  j 

on  terminal  area  route  design  considerations.  A more  meaningful  analysis  from 
an  RNAV  system  designer's  viewpoint  would  be  to  separate  the  various  TSCT  errors 
by  system  type.  Using  the  categories  defined  in  AC  90-45A  and  explained  in 
Section  3.0,  Table  3.1,  the  following  classifications  of  TSCT  are  achieved. 


TABLE  3.34  TSCT  ERROR  CLASSIFIED  BY  SYSTEM  TYPE 


Two  Sigma  TSCT  Errors 
(nm) 

Category  (Re:  AC90-45A) 

(1) 

(2) 

(3) 

Collins  (Man/Auto) 



0.4/0. 3 

— 

King  (MIA/OEN) 

1.0 

-- 

-- 

Litton  (NAFEC) 

— 

0.8/0. 7 

Butler  (NAFEC) 

1.2 

-- 

-- 

King  (NAFEC) 

1.5 

-- 

-- 

Delco  (ORD) 

1.1 

-- 

-- 
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This  breakdown  shows  that  the  systems  tested  in  each  category  meet  the 
corresponding  limits  of  AC  90-45A  which  were  delineated  in  Table  3..  1 . 

Finally,  final  approach  TSCT  data  was  obtained  from  the  tests  of  the 
Collins  and  the  King  RNAV  systems.  Statistical  aggregations  of  28  DME/DML 
approaches  and  32  VOR/DME  approaches  showed  both  techniques  satisfied  the 
required  RNAV  final  approach  accuracy  of  ’0.6  nm  specified  in  AC  90-45A. 

In  summary,  it  can  be  concluded  that  RNAV  accuracy  is  well  within  current 
specified  limits  for  enroute,  terminal  and  approach  airspace.  Table  3.32  fur- 
ther substantiates  the  Task  Force  and  AC  90-45A  assumption  of  essentially  a 
zero  mean  error  when  a statistically  significant  number  of  samples  is  aggre- 
gated. Table  3.34  shows  that  using  an  RNAV  system  of  the  category  (2)  class 
defined  by  AC  90-45A  in  either  manual  or  autopilot  modes  results  in  less 
than  ’0.5  nm  total  system  error. 

3.6.2  Accuracy  of  Airline  RNAV  Systems 

Before  proceeding  to  other  FTE  related  RNAV  issues  it  is  important  to  dis- 
cuss the  two  broad  operational  categories  of  RNAV  systems.  These  are  airline 
quality  systems  and  minimum  capability  systems.  The  design  differences  and 
the  functional  specifications  for  each  type  of  system  is  thoroughly  reviewed 
in  Reference  8 - "Preliminary  RNAV  Avionics  Standaids".  Basically,  the  airline 
quality  systems  are  designed  and  manufactured  to  the  rigorous  specifications 
defined  by  the  ARINC  (Aeronautical  Radio,  Inc.)  area  navigation  system  speci- 
fications [19,20,21].  In  the  process  of  generating  the  three  levels  of  RNAV 
characteristics , ARINC  has  developed  a comprehensive  set  of  airline  oriented 
system  functional  and  accuracy  characteristics.  The  impact  of  implementing 
these  characteristics  on  total  system  accuracy  was  implicitly  illustrated  in 
Table  3.34  of  Section  2.6.1.  This  section  will  explicitly  enumerate  the  dem- 
onstrated airline  system  accuracy  data. 

The  airline  quality  systems  tested  were  the  Delco,  Collins  and  Litton 
systems.  These  three  systems  cover  the  spectrum  from  a VOR/DME  Mark  13  system 
[21]  through  a full  inertial  Mark  2 [20]  system.  The  Delco  data  is  most  repre- 
sentative of  the  Mark  13  quality  system.  Referring  to  Table  3.31  of  the  pre- 
ceding section,  it  can  be  seen  that  for  both  the  enroute  and  terminal  area 
data  this  system  performed  well  within  the  specified  accuracy  tolerances.  En- 
route the  TSCT  data  ranged  from  *0.6  to  *0.9  nm  (two  sigma)  and  never  exceeded 
the  more  stringent  post-1982  enroute  accuracy  tolerance  of  -2.5  nm  (constant). 
Appendix  B,  Tables  B.l  and  B.2  present  the  individual  flight  statistics  for 
both  autopilot  and  manual  flights  respectively. 

Terminal  area  statistics  for  the  Delco  system  were  obtained  in  the  Denver 
and  Chicago  terminal  areas.  Once  again,  the  system  accuracy  statistics  veri- 
fied that  both  present  (*2.0  nm)  and  anticipated  ('1.5  nm)  accuracy  tolerances 
were  easily  achieved.  The  most  meaningful  statistical  aggregation  was  obtained 
in  the  Chicago  terminal  area  where  twelve  arrival  flights  were  aggregated. 

Table  3.31  of  the  previous  section  shows  that  a 'l.i2  nm  TSCT  was  measured. 

This  two  sigma  accuracy  is  44  less  than  the  *2.0  nm  limit  and  35T  less  than 
the  *1,5  nm  limit.  The  95  confidence  interval  for  the  data  from  the  twelve 
fl  ights  is  *0.23  nm. 
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The  Collins  RNAV  system  tested  conformed  to  the  ARINC  Mark  2 characteris- 
tics [20]  without  the  optional  inertial  inputs.  This  system  utilizes  two  VOR 
receivers  and  two  DME  receivers  for  position  determination  (VDVD  mode).  This 
system  normally  operates  in  a ranked  hierarchy  computational  mode  which  uses 
all  four  system  inputs  in  a weighted  average.  When  suitable  station  geometry 
exists,  this  weighted  hierarchy  results  in  primarily  a DME-DME  (D-D)  mode  of 
position  determination.  For  purposes  of  experimental  evaluation,  the  system 
was  tested  not  only  in  the  nonnal  VDVD  mode,  but  also  in  a forced  D-D  mode 
where  the  VOR  receivers  were  disconnected  and  a forced  VOR-DME  (V-D)  mode  where 
only  single  VOR  receiver  and  DME  receiver  inputs  were  available  for  position 
determination.  Once  again  Table  3.31  should  be  consulted  for  the  results  of 
this  testing.  Both  autopilot  and  manual  data  was  acquired  for  all  computational 
modes.  The  results  of  this  high  quality  RNAV  system  were  less  than  *0.5  nm  two- 
sigma  TSCT  in  the  autopilot  and  manual  modes  for  all  computational  techniques 
in  every  case  but  the  V-D  manual.  Even  the  V-D  manual  data  was  only  *0.59  nm. 

A detailed  data  summary  of  the  test  pattern,  pilot  procedures  and  data  process- 
ing is  contained  in  Reference  22. 

The  relative  accuracy  of  this  system  compared  to  the  minimum  capability 
systems  is  also  apparent  in  Table  3.31.  The  King  and  Butler  TSCT  data  was  from 
three  to  five  times  less  accurate  than  the  Collins  system.  The  detailed  analy- 
sis of  the  King  and  Butler  data  will  be  performed  in  Section  3.6.3.  However, 
the  relative  tracking  accuracy  of  the  two  extremes  of  currently  available  area 
navigation  systems  is  quite  interesting.  The  underlying  implication  of  this 
data  is  that  although  all  systems  tested  proved  satisfactory  using  both  current 
and  anticipated  airspace  limits,  there  is  currently  avai  lable a large  (three  to 
five  times)  improvement  in  total  system  accuracy.  The  airspace  planners  and 
air  traffic  controllers  can  certainly  employ  this  improved  accuracy  capability 
in  solving  any  future  planning  or  procedural  design  problems.  However,  this 
would  require  upgrading  the  price  of  entry  into  RNAV  from  the  users  viewpoint 
and  the  minimum  system  performance  specification  to  which  manufacturers  must 
certify  the  equipment. 

The  final  airline  quality  systam  tested  was  the  LTN  104  full  inertial  sys- 
tem. This  system  was  also  tested  in  the  experimental  environment  of  NAFEC  as 
opposed  to  the  Delco  data  which  was  obtained  in  the  current  Chicago  operational 
environment.  This  system  is  also  a Mark  2 system  as  was  the  Collins,  but  with 
the  addition  of  inertial  position  determination  inputs.  Once  again  both  enroute 
and  terminal  data  were  well  within  all  specified  limits.  In  fact,  no  significant 
differences  were  apparent  for  either  airspace  region.  A slight  improvement  in 
TSCT  accuracy  was  observed  for  automatic  (*0.60  nm)  compared  to  manual  ('0.75) 
updating.  The  enroute  data  was  less  than  the  ‘4.0  nm  limit  by  a factor  of  5.3 
while  the  terminal  area  data  was  less  than  the  '2.0  nm  limit  by  a factor  of 
2.6  times. 

To  summarize,  the  three  airline  quality  systems  evaluated  demonstrated  ex- 
tremely good  total  system  accuracies  for  both  enroute  and  terminal  area  opera- 
tions. No  significant  degradation  in  accuracy  was  measured  in  manual  vs.  auto- 
pilot modes.  Similarly,  no  significant  TSCT  error  increases  were  measured  for 
VOR-DME  vs.  DME-DME  navigation  with  these  systems.  Total  System  Cross  Track 
accuracy  is  clearly  not  an  operational  problem  with  these  high  quality  RNAV 
systems.  In  fact,  these  systems  offer  a means  of  upgrading  the  achievable  ac- 
curacy tolerances  if  the  need  arises  in  future  NAS  planning. 
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3.6.3  Mi n j mum_ _R N A V_  System  ^a^ab i 1 i J;j e s 

The  discussion  of  Section  3.6.1  summarized  RNAV  system  performance  capa- 
bilities in  an  overall  sense  for  the  various  systems  tested.  It  is  important 
to  note,  however,  that  ATC  procedures  and  RNAV  route  designs  must  include  the 
consideration  of  the  capabilities  of  the  minimum  acceptable  RNAV  system.  For 
this  reason,  and  to  point  out  the  fact  that  the  minimum  systems  tested  were 
found  compatible  from  a total  system  accuracy  viewpoint,  the  following  TSCT 
data  summary  is  presented. 

The  single  waypoint  King  RNAV  system  was  utilized  to  evaluate  RNAV 
accuracy  in  the  operational  environments  of  Miami  and  Denver  terminal  areas. 

The  operational  analysis  of  these  experiments  is  summarized  in  a flight  by 
flight  description  presented  in  Appendices  C and  D respectively.  The  total 
system  accuracy  analysis  of  the  data  obtained  from  these  experiments  was  per- 
formed using  ARTS  III  tracking  data  from  the  FAA  TRACON  facilities  at  the  re- 
spective terminals.  There  were  a total  of  37  flights  performed  in  these  two 
experiments  and  the  A. C. 500/King  statistical  results  presented  so  far  in  this 
report  have  been  from  a combination  of  all  these  operational  tests.  The  fol- 
lowing analysis  separates  these  results  and  shows  statistics  and  graphs  to 
verify  the  conclusion  that  the  minimum  capability  RNAV  system  can  perform  sat- 
isfactorily in  the  operational  environments  tested. 

The  specific  terminal  area  arrival  routes  flown  during  the  operational 
evaluations  are  shown  in  Appendices  C & D along  with  an  experiment  matrix 
which  delineates  the  number  of  flights  per  route  and  the  other  experiment  var- 
iables such  as  subject  pilots,  type  of  approach  and  GDI  sensitivity.  Table 
3.35  presents  the  results  from  these  operational  tests  in  the  form  of  statis- 
tical aggregations  which  were  done  for  all  the  flights  on  a particular  RNAV 
STAR  and  then  the  data  from  each  STAR  was  combined  with  comparable  data  from 
all  STARS  flown.  In  Table  3.35,  these  summary  statistics  are  presented  for 
terminal  area  and  final  approach  airspace.  In  addition,  the  Denver  flight  test 
included  8 parallel  offset  routes.  Consequently,  the  Denver  portion  of  Table 
3.35  also  specifies  parallel  offset  total  system  accuracy.  The  results  shown 
substantiate  the  conclusion  that  the  accuracy  attainable  is  within  the  current 
FAA  Flandbook  7110.18  [7]  aircraft  separation  limits.  The  current  value  of  the 
limit  for  terminal  area  operations  is  '2.0  nm.  As  shown  in  Table  3.35,  the 
worst  two  sigma  TSCT  error  was  only  '1.2  nm  on  a 95"'  probability  basis.  For 
comparison,  the  Miami  results  showed  a two  sigma  95%  probability  of  '0.8  nm. 

Both  of  these  data  sets  showed  a central  tendency  for  pilots  to  fly  the  aircraft 
to  the  left  of  desired  track.  The  Denver  mean  or  bias  error  was  0.27  nm  and 
the  Miami  error  was  0.15  nm  both  left  of  desired  track.  Figures  3.58  and  3.59 
illustrate  the  statistical  results.  The  Miami  data  was  chosen  because  the  lar- 
gest number  of  flights  (12)  on  a given  STAR  were  flown  in  Miami.  These  figures 
show  the  relationship  between  the  0. 15L  *0.8  nm  terminal  area  statistical  results 
and  the  physical  airspace  boundaries  used  for  planning  purposes.  As  previously 
stated,  the  data  shown  is  within  the  current  limits  and  except  for  initial  track 
acquisition  data,  considerable  margin  is  obvious  within  the  *2  nm  airspace 
limit.  In  addition,  the  data  in  Figure  3.58  from  HARRIS  to  BAKER,  BAKER  to  FROG 
and  COOPER  to  MAP  illustrates  the  left  of  course  central  tendency  as  does  the 
NEW  RIVER  to  FROG  and  COOPER  to  FROG  data  on  Figure  3.59. 
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.C. 500/KING  TOTAL  SYSTEM  ACCURACY  ON  THE  PIKE  ONE  RNAV 

ARRIVAL  IN  MIAMI 


FIGURE  3.59  A. C.500/KING  TOTAL  SYSTEM  ACCURACY  ON  THE  NEW  RIVER  ONE 

KNAV  ARRIVAL  IN  MIAMI 
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The  reason  for  this  distinctly  non-zero  bias  error  is  not  thoroughly  under- 
stood at  this  time.  However,  the  possibility  of  a parallax  error  due  to  the 
location  of  the  GDI  was  a possible  cause  which  was  investigated.  It  was  found 
that  the  location  of  the  GDI  in  the  A.G.500  installation  was  such  that  parallax 
could  not  have  caused  the  measured  mean  errors.  In  fact,  parallax  would  tend 
to  cause  an  error  in  the  opposite  direction  for  the  specific  installation  tested. 
Regardless  of  the  cause,  if  the  absolute  value  of  mean  error  is  added  to  the  two 
sigma  error,  the  Denver  terminal  area  error  measurements  show  ±1.47  nm  and  the 
Miami  results  show  ±0.95  nm.  both  of  these  measured  accuracy  tolerances  are 
well  within  the  +2.0  nm  currently  specified  in  Handbook  7110.18  [7]. 

Examination  of  the  final  approach  results  on  Table  3.35  shows  somewhat  dif- 
ferent results.  The  *0.6  nm  two  sigma  measured  in  Denver  and  the  ±0.4  nm  two 
sigma  from  Miami  both  satisfy  current  RHAV  system  accuracy  limits  specified  in 
AG  90-45A  (.-O.G  nm)  and  in  the  Task  Force  Report  (*.9  Phase  1,  ±.8  Phase  2,  ±.6 
Phase  3).  The  FAA  airspace  planning  handbook  [7]  does  not  contain  an  approach 
limit.  However,  unlike  the  terminal  area  statistics,  if  the  central  tendency 
errors  are  added  to  the  +2  sigma  values  then  the  system  tested  exceeds  the  spe- 
cified limits.  The  demonstrated  accuracies  in  this  case  become  +0.91  nm  (Denver) 
and  +0.70  nm  (Miami).  Since  no  peculiar  reason  for  the  central  tendency  was 
found,  and  since  the  number  of  flights  used  in  both  experiments  should  produce 
reliable  statistical  samples  (14  and  23  flights  respectively),  the  more  conser- 
vative estimate  which  includes  the  absolute  value  of  the  central  tendency,  should 
be  used  as  representative  of  final  approach  accuracy  for  the  minimum  capability 
RNAV  systems. 

Examination  of  Table  3.35  for  parallel  offset  tracking  shows  that  from 
±0.7  nm  (two  sigma)  to  ±0.88  nm  (two  sigma  plus  the  absolute  value  of  the  mean) 
is  an  attainable  accuracy.  These  are  steady  state  statistics  which  means  that 
data  was  aggregated  along  the  parallel  offset  route  segment  only  and  does  not 
include  total  system  cross  track  accuracy  while  intercepting  the  offset  or  re- 
turning to  the  parent  route.  These  accuracies  indicate  the  capability  of  fly- 
ing with  a ±2.0  nm  route  width  centered  about  the  parallel  offset  track. 

3.6.4  Qual i tative  Total  System  Performance  Gomparison 

The  previous  discussions  summarized  total  airspace  utilization  requi rements . 
Quantification  of  the  enroute , terminal  and  final  approach  accuracies  was  accom- 
plished using  all  available  flight  test  results.  A comparison  of  experimental 
versus  operational  total  system  accuracy  was  presented  to  substantiate  the  repre- 
sentati  veness  of  the  experimental  results.  Finally,  minimum  RNAV  total  system 
accuracy  was  quantified  to  document  the  lower  limit  of  system  accuracy  and  the 
upper  limit  of  airspace  required  in  an  area  navigation  environment.  This  sec- 
tion completes  the  discussion  of  both  the  minimum  system  performance  and  the 
relative  system  performance  for  three  levels  of  RNAV  equipment. 

This  discussion  is  centered  about  data  obtained  during  the  Denver  terminal 
area  operational  testing.  During  these  tests,  three  levels  of  RNAV  systems  in- 
stalled in  three  distinct  performance  classes  of  aircraft  flew  the  same  terminal 
area  routes.  The  three  ai rcraf t/RNAV  combinations  tested  were: 

DG-lO/Delco  - Airline  quality 

G-l/Gollins  - Airline  quality 

A. G. 500/King  - General  aviation  quality 


The  results  of  the  terminal  area  evaluation  using  these  three  systems  will 
be  discussed  to  accomplish  two  goals.  First,  an  illustration  will  be  presented 
which  documents  graphically  the  capabilities  of  the  general  aviation  RNAV  system 
tested  (minimum  capability  system).  These  capabilities  include  track  keeping 
accuracy,  performance  of  parallel  offsets  and  the  rapid  response  capabilities 
of  the  more  maneuverable  general  aviation  RNAV  equipped  users.  Second,  an  illus- 
tration and  supporting  statistics  will  be  presented  which  quantitatively  tie 
together  and  substantiate  the  overall  quantitative  results  which  indicated  that 
performance  accuracies  less  than  current  and  anticipated  terminal  area  route 
width  limits  were  achievable. 

Figure  3.60  presents  a composite  of  all  the  TRAIL  ONE  RNAV  arrivals  flown 
by  the  general  aviation  aircraft  during  the  Denver  tests.  This  STAR  was  essen- 
tially a straight-in  arrival  route  which  terminated  in  a final  approach  to  run- 
way 26L.  The  radar  tracks  of  the  A.C.  500  test  vehicle  shown  illustrate  several 
interesting  facts.  First,  note  that  the  parent  route  centerline  connects  the 
BYERS,  FRED  and  TRAIL  waypoints.  In  addition  to  the  parent  route,  the  primary 
track  keeping  accuracy  aids  provided  are  the  dashed  and  solid  parent  route 
boundaries  which  were  derived  from  the  Phase  2 (1977-1982)  Task  Force  limits 
and  the  current  FAA  Handbook  7110.18  limits  respectively.  For  reference,  the 

dashed  line  is  *1.5  nm  and  the  solid  boundary  is  *2.0  nm.  Inspection  of  the 

plot  shows  that  the  centerline  tracking  flights  (5  and  17)  remained  within  *1.0 
nm  for  the  entire  length  of  STAR.  The  BYERS  and  FRED  segment  is  24  nm  long. 

Flight  05  illustrates  the  excellent  response  to  ATC  mentioned  earlier.  At  about 
8.0  nm  prior  to  FRED,  this  flight  was  given  a 4 nm  right  offset.  The  pilot  has 
completed  the  proper  45°  heading  change  less  than  0.5  nm  later  (less  than  15 
seconds  at  120  knots).  Then  when  the  flight  was  offset  only  1.0  nm,  ATC  cancelled 
the  previous  instruction.  The  pilot  quickly  returned  to  course  and  was  stabi- 
lized back  on  centerline  with  about  1.5  nm  to  go  to  FRED. 

Flights  11  and  18  on  Figure  3.60  illustrate  a right  and  left  4.0  nm  offset 
respectively.  This  type  of  offset  on  a 24  nm  route  segment  such  as  BYERS  to 
FRED  can  be  used  effectively  to  allow  faster  overtaking  aircraft  the  opportuni- 
ty to  [lass  a slower  aircraft.  As  a matter  of  fact,  the  relative  time  for  a 
120  knot  aircraft  and  a 200  knot  aircraft  to  traverse  this  segment  is  about  l2 
and  7 minutes  respectively.  A full  five  minutes  are  available  for  passing  of 
the  slower  aircraft  not  including  the  time  required  by  the  slower  aircraft  to 
depart  and  return  to  centerline.  These  5 minutes  also  represent  valuable  time 
and  fuel  savings  to  the  faster  aircraft.  Both  parallel  offsets  were  effectively 
performed  by  the  RNAV  equipped  G.A.  aircraft  test  vehicle  to  the  satisfaction  of 
the  controller.  These  offsets  necessitated  flying  a decentered  GDI  needle  using 
a scale  factor  of  4 dots  = 4 nm.  No  problems  were  encountered  with  this  paral- 
lel offset  procedure. 

Flight  11  on  the  FRED  to  BYERS  route  segment  illustrates  again  the  quick 
response  to  an  ATC  clearance  and  also  illustrates  an  RNAV  equipment  problem. 

On  this  flight,  while  in  the  transition  from  a 4 nm  right  offset  and  while  pre- 
paring the  aircraft  for  final  approach,  ATC  requested  a runway  change  from  26L 
to  26R.  The  subject  pilot  was  flying  simulated  IFR  (hooded)  under  the  super- 
vision of  a safety  pilot.  Since  the  subject  knew  approximate  parallel  runway 
eparation  was  1.0  nm  he  elected  to  fly  a 1.0  nm  right  offset.  This  was  done 
1 eptably  from  a pilot  workload  and  an  RNAV  indicated  position  (CDI  indicated 
dof  fly  left  during  the  entire  approach).  However,  as  shown  by  the  radar 
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track  on  Figure  3.60,  the  actual  aircraft  position  was  less  than  0.5  nm  to  the 
right  of  the  runway  26L  centerline.  This  discreoancy  between  indicated  RNAV 
position  (1  dot  fly  left)  and  the  actual  radar  position  is  NAV  system  cross 
track  error  (NOT).  This  includes  ground  and  airborne  sensor  errors  as  well  as 
RNAV  computer  error.  NCT  is  characteristically  -0.5  to  -0.6  nm  for  the  system 
tested  as  will  be  shown  in  Section  3.9.1.  Although  this  is  well  within  accept- 
able limits  as  defined  by  RSS  error  combination  for  ground  and  airborne  equip- 
ment, it  is  not  acceptable  in  the  final  approach  case  illustrated.  However, 
the  case  illustrated  where  a 1.0  nm  offset  on  final  approach  is  attempted  is 
atypical  and  should  not  taint  the  otherwise  acceptable  performance  previously 
documented  for  this  general  aviation  system.  This  error  was  only  pointed  out 
as  an  operational  problem  encountered  and  to  document  that  final  approach  off- 
sets should  probably  be  avoided  for  this  class  of  equipment. 

In  order  to  reestablish  the  generally  acceptable  total  system  accuracy 
previously  documented  for  the  general  aviation  system  and  to  provide  a direct 
comparison  of  three  levels  of  RNAV  equipment  on  an  identical  route  Table  3.36 
is  presented.  The  top  half  of  this  table  shows  the  combined  average  or  mean 
total  system  error  for  two  flights  on  each  of  the  RNAV  systems  indicated. 

No  values  are  shown  for  *2o  in  the  upper  half  since  2o  is  not  meaningful 
for  a sample  of  two  flights.  However,  the  value  of  the  mean  error  in  this 
case  illustrates  the  relative  performance  accuracy  and  repeatability  for  these 
systems  on  a common  RNAV  STAR.  Radar  tracks  of  the  two  flights  for  each  sys- 
tem have  been  overlayed  and  are  presented  in  Figure  3.61.  The  mean  errors  in- 
dicated in  Table  3.36  should  not  be  used  to  judge  one  system  against  another 
because  the  sample  size  of  two  flights  each  is  not  large  enough  to  be  meaning- 
ful. Rather,  these  means  should  be  interpreted  as  illustrating  that  all  three 
levels  of  RNAV  system  were  within  *0.6  nm  of  desired  track  based  on  a six 
flight  sample.  Unfortunately,  this  was  the  largest  compatible  data  set  avail- 
able. Also,  unfortunately,  the  STAR  on  which  the  data  was  available  was  a long 
straight  in  arrival.  However,  interpreted  literally  this  data  demonstrates 
compatibility  of  these  three  systems  on  the  type  of  arrival  illustrated. 

TABLE  3.36 

TOTAL  SYSTEM  CROSS  TRACK  ACCURACY 
KING  - COLLINS  - DELCO 


FIGURE  3.61  COMPARISON  OF  THREE  RNAV  SYSTEMS  ON  THE  TRAIL  ONE  STAR 


The  bottom  half  of  Table  3.36  presents  the  total  terminal  area  statistics 
obtained  in  the  Denver  terminal  area  for  the  three  levels  of  RNAV  systems. 

Again  the  relatively  small  sample  sizes  for  the  Del co  and  Collins  data  render 
the  i2o  values  somewhat  meaningless  in  an  absolute  analytical  sense.  However, 
the  intent  was  to  display  relativeness  using  the  best  comparable  data  set 
available.  This  half  of  the  table  does  show  that  the  Delco  and  Collins  systems 
demonstrate  a consistent  level  of  accuracy  for  the  airline  quality  equipment. 

The  King  data  serves  as  a representative  of  the  minimum  capability  RNAV  system 
using  total  system  accuracy  numbers.  The  King  data  was  based  on  14  flights 
which  is  consiaereo  a reliable  statistical  base.  Once  again  the  type  of  con- 
clusion which  is  meaningful  for  the  two  sigma  errors  shown  for  the  three  levels 
of  RNAV  system  and  the  sample  sizes  shown  is  that  these  numbers  plus  the  radar 
tracks  of  Figure  3.61  illustrate  the  compatibility  of  the  different  systems  in 
an  operational  environment.  Furthermore,  this  subset  of  statistics  and  the 
radar  tracks  of  Figure  3.61  graphically  illustrate  that  the  different  aircraft 
and  RNAV  systems  tested  stayed  within  +1.0  nm  of  desired  track.  (The  two 
sigma  TSCTs  from  Table  3.31  for  all  199  flight  tests  are  available.) 

In  summary,  total  system  cross  track  accuracy  was  measured  for  five  dif- 
ferent RNAV  system/aircraft  combinations.  Statistical  aggregation  of  both  ex- 
perimental and  operational  flight  test  results  showed  that  not  only  present, 
but  future  total  system  accuracy  tolerances  were  satisfied  in  both  enroute  and 
terminal  airspace.  Data  analysis  further  substantiated  the  Task  Force  and 
AC  90-45A  assumption  of  essentially  a zero  mean  error.  In  addition,  test  re- 
sults of  airline  type  RNAV  systems  in  both  manual  and  autopilot  modes  resulted 
in  less  than  *0.5  nm  total  system  error  in  terminal  area  operations.  Approach 
data  from  28  flights  of  the  Collins  Mark  2 airline  system  demonstrated  accu- 
racies on  the  order  of  +0.25  nm  which  was  also  well  within  final  approach  accu- 
racy requirements. 

Since  ATC  procedures  and  RNAV  route  designs  must  include  the  consideration 
of  the  capabilities  of  the  minimum  acceptable  RNAV  system,  evaluation  of  this 
category  was  an  explicit  element  of  the  total  system  accuracy  analysis.  The 
minimum  system  tested  was  found  to  be  compatible  in  both  enroute  and  terminal 
airspace  from  a total  system  accuracy  viewpoint.  In  fact,  the  demonstrated 
performance  was  well  within  the  current  '4.0  nm  enroute  and  '2.0  nm  terminal 
area  route  design  specifications.  However,  the  minimum  system  tested  demon- 
strated a significant  bias  in  the  final  approach  region.  The  impact  of  the 
0.31  nm  bias  on  the  0.47  nm  two  sigma  causes  the  AC  90-45A  final  approach  limit 
of  ‘0.6  nm  to  be  exceeded.  It  is  felt  that  the  more  conservative  accuracy  of 
0.78  nm  (.47  + .31)  should  be  used  to  represent  final  approach  accuracy  for 
minimum  capability  systems. 

Finally,  qualitative  and  limited  quantitative  analyses  were  performed  show- 
ing relative  functional  and  accuracy  capabilities  of  three  levels  of  RNAV  system 
on  an  identical  route  in  an  operational  environment.  All  three  levels  of  RNAV 
system  performed  satisfactorily  during  the  execution  of  this  particular  RNAV 
arrival  route.  In  addition,  analysis  of  the  limited  statistical  data  (two 
flights  per  system)  showed  that  all  three  levels  of  RNAV  stayed  within  ‘0.6  nm 
of  the  desired  track. 
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3.7  RNAV  ERROR  COMBINATION  AND  CORRELATION 


The  primary  purpose  of  this  section  is  to  demonstrate  the  conservatism 
inherent  in  the  current  RNAV  error  combination  technique.  This  will  be  accom- 
plished by  comparing  computed  total  system  cross  track  error  data  for  various 
RNAV  systems  with  the  values  for  TSCT  error  measured  using  tracking  radar. 

In  the  process  of  demonstrating  this  conservatism,  the  explicit  quantitative 
relationship  between  FTE  and  total  system  cross  track  error  will  be  defined. 
This  quantitative  relationship  supplements  the  knowledge  gained  implicitly  in 
Section  3.6  about  TSCT  errors  associated  with  various  RNAV  systems  and  FTE 
errors . 

A secondary  purpose  of  this  section  will  be  to  suggest  a possible  change 
to  the  RSS  error  combination  technique  which  will  improve  the  accuracy  with 
which  total  system  errors  can  be  calculated  from  a combination  of  measured 
error  sources.  Available  data  will  be  used  and  a preliminary  analysis  showing 
the  effectiveness  of  the  suggested  technique  will  be  performed.  The  indicated 
effectiveness  of  the  technique  will  be  demonstrated  for  both  airline  and  gen- 
eral aviation  RNAV  systems. 

The  Root-Sum-Square  (RSS)  error  combination  technique  simply  states  that 
the  square  root  of  the  sum  of  the  squares  of  the  RNAV  error  budget  components 
may  be  used  to  represent  the  total  system  error.  In  equation  form  and  related 
to  area  navigation  error  budget  elements,  this  translates  into: 

(1  ) 

TSCT  VOR  DME  RNAV  FTE 

However,  certain  theoretical  assumptions  must  be  applied  to  the  TSCT  error 
budget  elements  in  order  for  this  relationship  to  be  valid.  The  RSS  assump- 
tions include: 

(1)  Normal  distributions  for  the  error  sources. 

(2)  Linearity  - sensitivity  of  total  system  error  to  changes  in 
error  source  magnitudes  is  linear  (i.e.,  a 2°  VOR  error  im- 
pacts TSCT  the  same  as  twice  a 1°  VOR  error). 

(3)  Uncorrelated,  independent  errors. 

(4)  95  probability  defined  by  two-sigma  error  distribution. 

(This  is  true  if  (1)  is  true). 

(5)  Dynamics  of  the  system  are  negligible. 

(6)  Zero  mean  error  sources. 

Up  to  this  point,  none  of  the  above  assumptions  have  been  quanlifiably 
verified.  However,  the  results  presented  in  Section  3.1  indicated  that  at 
least  assumptions  (1),  (4)  and  (6)  were  valid  for  flight  technical  error. 

The  assumption  most  questionable  from  an  analytical  view()oint  is  number  (3). 

The  presumed  indef'endence  of  FTE,  RNAV  computer  and  total  system  errors  as  well 
as  the  assumption  that  these  errors  are  uncorrelated  seems  naive  if  not 
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unreasonable.  Similarly,  VOR/DME  sensor  errors  and  RNAV  computer  errors  are 
not  logically  assumed  to  be  uncorrelated  and  independent.  The  reason  for 
questioning  the  validity  of  these  previously  accepted  assumptions  is  that  in 
each  case  stated  there  is  an  a priori  relationship  of  one  error's  magnitude  as 
a function  of  the  input  errors  from  other  sources.  For  example,  any  actual 
error  in  the  VOR  (or  DME)  signal  received  is  a direct  input  into  the  RNAV 
computer.  After  processing  the  signal  and  possibly  some  form  of  filtering, 
the  RNAV  output  is  displayed  to  the  pilot.  There  is  obviously  a direct  func- 
tional relationship  between  the  displayed  RNAV  position  (which  adds  computer 
and  display  errors)  and  the  received  signal  errors.  In  addition,  the  pilot's 
reaction  to  the  displayed  RNAV  information  is  definitely  dependent  on  and 
probably  correlated  to  one  or  more  of  the  RNAV  error  sources  - VOR,  DME,  OBS, 
computer  or  display.  Once  the  functional  dependency  is  understood,  it  is 
possible  to  quantify  and  relate  the  error  sources  in  a mathematical  sense. 

The  functional  loop  is  closed  when  the  pilot's  reaction  to  the  processed  and 
displayed  sensor  inputs  results  in  aircraft  movement  which  is  recorded  and 
measured  as  total  system  error  relative  to  a desired  course.  This  total  sys- 
tem error  must,  therefore,  be  calculated  by  taking  into  account  the  quantified 
error  correlations. 

In  order  to  substantiate  or  negate  the  suspected  relationships,  the  error 
correlations  must  be  evaluated.  This  evaluation  will  begin  with  an  overall 
assessment  of  whether  correlation  exists  between  FTE  and  the  net  result  or 
Total  System  Cross  Track  error.  The  analysis  will  then  progress  toward  estab- 
lishing the  precise  correlation  for  a sample  set  of  flight  test  data. 

3.7.1  the  RSS  Error  Combination  Technique 

Currently  the  RSS  error  combination  is  recommended  in  AC  90-45A,  Appen- 
dix C as  an  error  combination  technique  suitable  for  system  design,  airspace 
planning  and  demonstration  of  compliance.  However,  current  flight  test  re- 
sults show: 

(1)  FTE  is  the  same  order  of  magnitude  as  system  cross  track,  and 
not  one  half  as  large  as  assumed  by  the  Task  Force  for  Phase  1. 

(2)  The  RSS  technique  is  conservative  (33  -35  ),  and  this  may  no 
longer  be  acceptable  in  the  reduced  route  width  environment 
of  Phases  2 and  3 of  RNAV  implementation  and  is  overly  con- 
servative in  today's  environment. 

(3)  FTE  correlates  with  other  error  quantities,  which  invalidates 
the  RSS  assumption. 

Error  cor’hination  using  the  reconnended  RSS  techniqtn  innl'.ci'.ly  assirtes 
tnat  none  of  tne  error  budget  component  error  magnituaes  will  be  equal  to  or 
greater  than  the  measured  total  system  error.  That  is,  if  during  a flight 
test  experiment,  measured  total  system  error  was  *2.0  nm  with  a zero  mean  atui 
for  the  same  data,  measured  FTE  was  *2.0  nm  then  the  RSS  equation  cannot  pos- 
sibly predict  tlie  correct  measured  TSCT  if  other  elements  are  added  to  FTE, 

For  example,  if  the  combined  ground  and  airborne  VOR  error  was  *1.0  nm,  the 
combined  ground  and  airborne  DME  error  was  *0.1  nm  and  the  RNAV  computer  error 
was  0.5  nm.  The  RSS  technique  (Equation  (1))  would  predict: 
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TSCT  = 


For  the  hypothetical  case  being  discussed  this  would  be  in  error  by  about 
15%.  The  error  would  be  conservative  since  the  computed  TSCT  would  be  larger 
than  that  actually  measured.  This  example  was  presented  to  illustrate  the 
fact  that  if  FTE  (or  any  of  the  other  error  budget  elements)  is  very  close  in 
magnitude  to  TSCT  measured,  then  the  RSS  computed  TSCT  cannot  be  used  as  an 
accurate  computation  technique  to  predict  total  system  error.  Flight  test 
data  substantiating  that  this  case  actually  exists  is  shown  in  Figure  3.62. 

The  data  summarized  graphically  on  Figure  3.62  was  presented  in  tabular 
form  throughout  this  report.  Specifically,  the  FTE  two-sigma  statistics  were 
discussed  in  Section  3.1  and  tabulated  in  Table  3.3.  The  TSCT  two-sigma  sta- 
tistics were  discussed  and  presented  in  Section  3.6,  Table  3.31.  It  is  apparent 
from  this  graphical  summary  that  regardless  of  the  absolute  accuracy,  the  RNAV 
system  sophistication,  or  the  navigation  mode  (manual  or  autopilot),  current 
flight  test  results  indicate  that  TSCT  and  FTE  are  very  close  to  the  same  mag- 
nitude. This  fundamental  conclusion  can  be  interpreted  as  an  indication  that 
for  the  low  cost,  general  aviation  systems,  if  measured  TSCT  is  *1.5  nm,  then 
measured  FTE  will  be  '1.5  nm.  This  is  due  to  the  lack  of  sophisticated  sensor 
signal  filtering  by  the  RNAV  system,  the  types  and  sensitivities  of  displayed 
information,  and  the  characteristic  experience  level  and  flying  techniques  of 
the  general  aviation  pilots  using  them.  This  conclusion  is  not  all  that  sur- 
prising. However,  the  lower  end  of  the  data  shown  in  Figure  3.62  is  somewhat 
different  than  expected.  Based  on  a significant  sample  of  both  manual  and 
autopilot  flights,  this  data  shows  that  even  with  sophisticated  RNAV  equipment, 
accurate  sensor  signals  and  with  the  pilot  taken  out  of  the  loop  (autopilot 
coupled),  if  measured  TSCT  is  *0.3  nm  the  FTE  is  ‘0.2  nm.  As  stated,  this  type 
of  relationship  between  component  errors  and  total  system  error  precludes  use 
of  the  RSS  computation  technique  if  an  accurate  assessment  of  total  system 
accuracy  is  a requirement  and  if  radar  measurements  of  actual  aircraft  track 
are  not  a plausible  method  for  obtaining  the  desired  estimate. 

Before  addressing  the  possible  alternatives  to  the  RSS  computation  of  TSCT 
error  magnitudes,  it  is  interesting  to  estimate  the  degree  of  conservatism  re- 
sulting from  the  RSS  method  of  error  combination.  The  interest  evolves  from 
the  distinct  possibility  that  this  conservatism  may  be  a desirable  element  for 
airspace  design  and  RNAV  system  certification  purposes.  Indeed,  the  standard 
argument  that;  "The  RSS  technique  has  been  used  successfully  for  years  so  why 
should  it  be  changed  now?",  may  be  a valid  point  of  view.  The  key  to  the  valid- 
ity or  invalidity  of  this  argument  is  whether  or  not  a change  is  necessary 
"now"  and  if  not  now,  when  the  change  might  become  a requirement.  Figure  3.63 
can  be  used  to  explore  possible  answers  to  all  of  these  inquiries. 


|[l.O)-’  + (0.1)2  + (0.5)2  + (2.0)2]  '' 

15.26] 

2.29  nm 
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Fiqure  3.62  Comparison  of  FTE  Magnitude  to  Total  System  Cross 
Track  Error  for  Various  Levels  of  RNAV  Equipment 
(Steady  State  Data,  Zero  Mean  Assumed,  2) 
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Fiqure  3.63  Comparison  of  RSS  and  Total  Systeu  Cross  Track  Trror 
for  Various  Levels  of  RilAV  System  Complexity 


The  abscissa  of  Figure  3.63  is  total  system  error  derived  from  tracking 
radar  position  measurements  compared  to  desired  RNAV  course.  Results  shown  in- 
clude the  G-l/Collins  and  Butler  data  acquired  at  NAFEC  using  precision  track- 
ing radar  as  well  as  flight  test  results  from  the  operational  experiments  at 
Miami  and  Denver  using  ARTS  III  radar.  These  measured  TSCT  errors  are  plotted 
against  RSS  computed  TSCT  error  for  the  same  data.  The  RSS  computations  were 
based  on  airborne  measurements  of  sensor,  computer  and  flight  technical  error 
components.  The  results  shown  clearly  indicate  that  for  measured  total  system 
errors  greater  than  1.0  nm  the  RSS  technique  is  more  than  30%  conservative. 

The  results  also  indicate  a general  trend  for  less  data  scatter  and  less  con- 
servatism for  the  G-l/Collins  results  (airline  quality  system)  compared  to  the 
G-l/Butler  or  the  A.C.  500/King  results.  However,  the  percent  conservatism 
remains  approximately  the  came  for  both  airline  quality  and  general  aviation 
systems.  This  graphically  and  quantitatively  answers  the  question  about  the 
degree  of  conservatism  of  the  RSS  computation.  The  33%  to  35%  conservatism 
essentially  provides  an  additional  amount  of  buffer  airspace  over  and  above 
what  would  be  supplied  by  a precise  RSS  two-sigma,  95%  conridence  error  com- 
bination technique  for  TSCT.  In  reality,  the  sigma  value  for  the  current  RSS 
technique  is  much  higher  than  two  due  to  the  error  dependence  and  correlation 
which  produces  an  inflated  and  conservative  estimate  of  TSCT. 

Interpretation  of  Figure  3.63  in  a slightly  different  manner  answers  the 
question  about  when  a change  from  RSS  might  become  a requirement.  It  was  noted 
on  the  figure  that  the  RSS  technique  resulted  in  computed  TSCT  errors  35^^  larger 
than  measured  at  an  RSS  value  of  2.0  nm  and  SS"  larger  than  measured  at  an  RSS 
value  of  1.5  nm.  Stated  another  way,  when  the  RSS  computation  indicated  that 
the  flight  tested  RNAV  system  was  capable  of  operating  with  -2.0  nm  two-sigma 
route  widths,  the  actual  measured  two-sigma  TSCT  accuracy  was  ‘1.3  nm.  This 
•1.3  nm  perforr,,ance  may  appear  somewhat  unrepeatable  based  on  the  data  scatter 
of  Figure  3.63.  However,  it  should  be  recalled  that  the  aggregation  of  199 
flights  shown  in  Table  3.31  showed  a ‘1.04  nm  two-sigma  route  width  capability. 
The  two-sigma  capability  represented  by  this  data  may  be  assumed  to  correspond 
to  a 95%  probability  that  all  aircraft  will  be  within  the  ‘1.04  nm  route  width. 
Although  the  experimental  data  contained  slightly  more  data  in  the  extreme  tail 
of  the  normal  distribution,  additional  statistical  editing  would  conventionally 
disregard  such  data.  For  example,  the  one-sigma  data  bandwidth  corresponded 
exactly  to  a 68%  probability  while  the  two-sigma  data  bandwidth  was  slightly 
less  than  the  95"  probability  number.  Since  editing  was  performed  from  opera- 
tional rather  than  mathematical  considerations,  the  distribution  was  close  enough 
to  95"  probability  to  be  considered  acceptable.  Further  editing  could  be  per- 
formed to  make  the  two-sigma  and  95"  probability  values  identical  as  were  the 
one-si gma/bS"  numbers.  This  cross  validation  of  the  conservatism  of  the  RSS 
technique  is  quite  impressive.  The  reason  for  the  large  scatter  shown  in  the 
figure  is  that  it  was  desired  to  show  the  computed  and  measured  TSCT  comparison 
on  an  individual  route  segment  basis  across  several  flights.  This  introduces 
more  scatter  especially  in  the  VOR  and  FTE  statistics  due  to  signal  noise, 
scalloping  and  cockpit  workload  variations  on  individual  seinients. 

At  a computed  TSCT  accuracy  of  ‘1.5  nm,  the  conservatism  is  about  33  . 
Measured  TSCT  at  this  point  was  1.0  nm  two-sigma.  This  leads  to  the  impli- 
cation that  a change  from  the  RSS  may  be  necessary.  Specifically,  as  stated 
earlier,  the  RSS  technique  has  been  applied  acceptably  and  is  currently  com- 
patible with  a ‘2.0  nm  route  width  requirement.  The  current  RNAV  svstem 
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design  certification  tables  of  AC  90-45A  are  based  on  the  RSS  technique.  The 
±2.0  nrn  route  width  is  generally  used  for  airspace  planning  and  designing  RNAV 
procedures.  However,  if  a change  in  the  ±2.0  nm  route  width  becomes  a regu- 
latory necessity,  then  the  conservatism  of  the  RSS  technique  may  become  an 
unnecessary  luxury.  That  is  to  say  that  more  accurate  techniques  for  error 
combination  may  be  required  for  both  system  certification  and  airspace  plan- 
ning purposes. 

3.7.2  Recommended  Error  Combination  Techniques  Suitable 
for  Further  Substantiation 


Since  the  similarity  in  magnitudes  of  FTE  and  TSCT  errors  almost  precludes 
the  usage  of  the  RSS  error  combination  technique  and  since  the  RNAV  Task  Force 
has  recommended  reduction  of  terminal  area  route  width  requirements  from  the 
current  ±2.0  nm  to  *1.5  nm  by  1977  it  is  necessary  to  define  more  accurately  the 
magnitude  of  achievable  route  widths.  To  accomplish  this,  a more  accurate  yet 
easily  employed  error  combination  technique  is  desired. 


The  most  suspect  basic  RSS  assumption  is  that  the  TSCT  errors  are  uncor- 
related and  independent.  The  basic  reasons  for  suspecting  error  correlation 
have  been  previously  discussed.  In  addition,  based  on  empirical  results,  the 
33  to  35%  conservatism  indicated  for  the  RSS  technique  verifies  the  suspicion 
that  a negative  correlation  may  exist  between  some  of  the  error  budget  elements. 
For  this  reason,  an  examination  of  incorporating  correlation  terms  into  the  RSS 
computational  technique,  and  establishing  possible  magnitudes  for  the  corre- 
lation terms,  was  initiated.  First,  the  basic  approach  will  be  described. 

Then  the  approach  will  be  illustrated  for  two  levels  of  RNAV  equipment.  A1 though 
preliminary  indications  reqarding  „he  technique  are_quite  positive,  the  following 
analysis  is  only  an  illustration  of  the  plausibility  and  is  noi  intended  to  rep- 

LuM.t  a n t la  t j_qn . 


For  uncorrelated,  independent  error  sources  the  RSS  computation  technique 
illustrated  in  equation  (1)  is  valid.  This  equation  can  be  simplified  if  the 
ground  and  airborne  VOR  and  DME  components  are  combined  into  a "sensor"  or 
"radio"  error  quantity.  Equation  (1)  then  becomes: 


O'  =0^  +0^  ± 

TSCT  Sensors  Computer  FTE  (2) 

or 

= 0?  + 02 

TSCT  NS  FTE  (3) 

where  0^^^  = measured  navigation  system  error  which  includes  sensor  input, 

computer  signal  smoothing  and  filtering  and  RNAV  computer  error. 

1",  however,  the  errors  are  correlated,  then  using  the  RSS  technique  is 
not  valid  and  equations  must  be  developed  wtiich  include  sufficient  cross  cor- 
relation terms  to  account  for  the  differences  previously  indicated  between 
computed  and  measured  TSCT  errors,  in  this  case. 
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The  correlation  coefficient  p is  generally  defined  as  the  quantitative 
measure  of  association  between  variables.  When  p is  1.0  perfect  positive 
correlation  exists.  When  p is  zero  there  is  no  correlation  and  when  p is  -1.0 
perfect  negative  correlation  between  the  variables  is  indicated.  Including 
the  correlation  coefficient  between  navigation  system  errors  (also  called  equip- 
ment error)  and  FTE,  equation  (3)  becomes: 

0^  = + 7^  + 2p  a a 

TSCT  NS  FTE  NF  NS  FTE  (4) 

where 

p = the  correlation  coefficient  between  navigation  system  and 
NF  FTE  errors 

and  the  equation  normally  used  for  computing  the  value  of  v is 

NT 

p = Covariance  of  NAV  system  and  FTE 

NF  square  route  of  the  product  of  variances  of  NAV  system  and  FTE 

p = Covariance  (N.S. , FTE) 

NF  ‘ (5) 

^ NS  FTE'' 

Similarly,  including  the  correlation  coefficients  in  the  more  detailed 
error  combination  equation  (2)  results  in  equation  (6) 

+0^  + 2p  o o + 2p  o a + 2p  a 0 (6) 

TSCT  SENS  COMP  FTE  SC  S C CF  C F SF  S F 

where 

p = correlation  coefficient  between  sensor  and  computer  errors 
SC 

p = correlation  coefficient  between  computer  error  and  FTE 
CF 


p = correlation  coefficient  between  sensor  errors  and  FTE 
SF 

It  can  be  seen  that  the  incorporation  of  correlation  coefficient  terms 
quickly  leads  to  a high  degree  of  complexity  in  the  calculation  of  total  system 
cross  track  performance.  In  fact,  if  equation  (1)  were  expanded  to  include  all 
possible  correlation  terms,  fifteen  correlation  coefficients  would  result.  The 
current  evaluation  of  alternative  error  combination  techniques  was  aimed  at 
resolving  the  problem  of  RSS  conservatism  previously  specified  while  keeping 
the  complexity  of  the  error  combination  and  correlation  analysis  to  a straight- 
forward technique  which  would  yield  the  desired  accuracy.  For  reasons  of 
simplicity,  therefore,  the  analysis  was  begun  using  equation  number  (4). 

As  a first  step  in  the  evaluation  of  the  correlation  between  navigation 
system  error  (all  equipment  errors  associated  with  RNAV)  and  FTE  (the  cross 
track  steering  error)  the  overall  data  sets  from  four  of  the  flight  test  pro- 
grams were  investigated.  Table  3.37  summarizes  the  number  of  flights  (samples) 
and  the  calculated  FTE  correlation  with  NAV  system  errors  for  each  of  these 
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four  experiments.  The  King  data  was  broken  down  into  two  subsets  due  to  the 
diversity  of  routes,  traffic  and  test  pilots  sampled  in  the  two  operational 
experiments. 

Upon  initial  investigation,  the  tabulated  values  for  p|^r  indicate  two 
trends.  First,  the  correlation  is  apparently  negative  for  all  the  experiments 
with  greater  than  14  flights.  Second,  there  seems  to  be  a difference  in 
correlation  significance  between  the  airline  quality  and  the  general  aviation 
RNAV  systems.  In  order  to  explore  the  latter  trend,  and  to  obtain  some  insight 
as  to  the  meaning  of  the  magnitudes  of  negative  correlation  indicated  in  the 
table,  a more  detailed  statistical  analysis  is  required. 


Table  3.37  CORRELATION  COEFFICIENT  SUMMARY  FOR 
FOUR  FLIGHT  TEST  PROGRAMS 


RNAV 

System 

Appl i cat  ion 

No.  of 
Flights 

Correlation 
Coefficient 
(NAV  System 
to  FTE) 
PNF 

COLLINS 

Ai rl ine 

28 

-0.12 

KING 

MIA 

General  Aviation 

23 

-O.7I 

DEN 

14 

-0.4 

BUTLER 

General  Aviation 

45 

-0.51 

DELCO 

Ai rl i ne 

3 

+0.22 

/Note/  1.  Strong  negative  correlation  is  indicated  (see 
Table  3.38). 


2.  No  correlation  exists  (see  Table  3.38) 


The  correlation  coefficient,  P|\^p,  can  also  be  interpreted  as  an  indi- 
cation of  the  reliability  of  the  association  between  correlated  variablt^ 

The  range  of  p[^p  can  be  from  -1  to  +1,  depending  on  the  deqrrc  ■ =' 
association.  Table  3.38  can  be  used  to  determine  the  siqni f i can- 
correlation  coefficient  computed  from  a sample  at  a certain  : : - . 

level.  This  table  provides  the  maximum  values  of  .vitiih  ■ 
by  chance  alone  when  actually  no  correlation  exists.  The  9S 
indicates  there  is  only  a 5 chance  of  having  . as  lar.n. 
when  no  correlation  exists.  Iji^rder  to  conclude  at  _ 
that  the  correlation  does  exist,  the  calculated  . L-..'  : r ' : . • . 

value  of  p. 
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Examination  of  Table  3.38  verifies  the  footnoted  conclusions  indi- 
cated on  Table  3.37.  That  is,  the  King  (MIA)  and  the  Butler  general  aviation 
data  show  a strong  negative  correlation  exists  between  navigation  system 
errors  and  FTE.  The  99%  confidence  level  values  of  Table  3.38  are  exceeded 
by  a significant  amount  for  both  of  these  data  sets.  The  King/DEN  data  does 
not  demonstrate  with  99%  confidence  that  a correlation  exists,  but  the  Pf^p  = 
-0.4  test  result  is  acceptably  close  enough  to  the  95%  confidence  level  to 
warrant  further  investigation  when  the  other  King  and  the  Butler  data  trends 
are  considered.  Finally,  the  p^p  correlation  does  not  apparently  apply  to 
the  more  sophisticated  airline  quality  RNAV  systems  of  the  Collins  and  Delco 
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types.  This  difference  in  results  for  G.A.  and  airline  systems  might  have 
been  expected  considering  the  more  sophisticated  software  and  the  more  accu- 
rate receivers  generally  associated  with  the  airline  systems. 

The  error  correlation  analysis  must  diverge  at  this  point.  First,  the 
present  technique  will  be  explored  in  more  detail  for  the  King  (MIA  and  DEN) 
results.  This  will  be  done  to  verify  on  a route  segment  by  route  segment 
basis  across  several  flights  that  the  negative  correlation  indicated  for 
general  aviation  systems  by  overall  test  results  is  not  a random  occurrence. 
Rather  it  will  be  shown  that  the  use  of  a negative  pNF  (value  to  be  determined) 
is  a reasonable  technique  for  computing  total  system  error  for  general  aviation 
systems  based  on  NAV  system  and  FTE  error  components.  Following  this  more  de- 
tailed analysis  of  the  general  aviation  results  will  be  a summary  of  the  correl- 
ation trends  for  airline  quality  RNAV  systems  derived  from  analysis  of  the  Delco 
data. 

3.7.3  General  Aviation  RNAV  System  Error  Correlation 

The  route  segment  statistics  used  for  the  more  detailed  NAV  system  and 
FTE  correlation  analysis  were  the  results  of  the  operational  flight  test  per- 
formance in  Denver  and  Miami.  These  results  were  chosen  because  the  highest 
confidence  level  that  a correlation  existed  was  observed  in  the  Miami  data 
while  less  than  a 95%  confidence  level  that  a correlation  existed  was  observed 
in  the  Denver  data.  Further  examination  of  these  two  data  sets  permits  a value 
judgement  to  be  made  based  on  a more  in  depth  analysis.  The  value  judgement 
in  question  is  whether  or  not  a correlation  coefficient,  pNF,  can  be  established 
which  will  permit  more  reliable  prediction  of  the  measured  total  system  cross 
track  error.  By  choosing  two  data  sets  showing  different  levels  of  possible 
correlation  from  an  overall  statistical  aggregation,  the  repeatability  and  re- 
liability of  the  correlation  coefficient  magnitude  can  be  established. 

The  correlation  coefficient  (pNF)  between  navigation  system  error  and 
FTE  was  calculated  across  all  the  flights  occurring  on  each  route  segment  in 
the  Miami  and  Denver  tests.  The  Miami  results  had  the  highest  number  of  flights 
(12)  per  segment  and  the  fewest  number  of  route  segments  (7).  Data  was  sub- 
divided into  "To"  and  "From"  modes  which  le^d  to  fourteen  calculated  pNF  values. 
The  negative  pNF  values  ranged  from  -0.33  to  -0.850  indicating  a significantly 
reliable  negative  correlation.  Although  the  magnitude  of  the  correlation  co- 
efficient was  somewhat  unrepeatable  segment  to  segment,  pNF  for  8 of  the  14  route 
segments  or  56%  of  the  data  was  between  -0.730  and  -0.850. 

Figure  3.64  is  a graphical  summary  of  the  Miami  and  Denver  route  segment 
correlation  coefficients.  It  should  be  remembered  that  on  an  overall  experi- 
ment basis,  the  Miami  results  indicated  a more  reliable  correlation  than  the 
Denver  data. 

The  Denver  data  consisted  of  a total  of  14  flights.  These  flights  were 
divided  over  3 STARs  and  data  distribution  varied  due  to  ATC  requests.  Some 
route  segments  only  included  2 flights  while  others  included  5.  This  small 
number  of  flights  per  segment  could  account  for  the  more  scattered  pNF  values 


calculated  and  plotted  in  Figure  3.64.  The  basic  range  of  the  data  scatter 
band  was,  however,  very  close  to  that  of  the  Miami  data.  Minimum  was 
-0.355  while  maximum  was  -0.979.  The  accuracy  and  reasonableness  of  assuming 
an  approximate  value  of  p = -0.7  are  illustrated  in  Figures  3.64  and  3.65. 

These  two-  figures  show  that  although  a constant  value  of  p = -0.7  is  only 
approximate,  the  33-35%  RSS  conservatism  can  be  accurately  reduced.  Using  this 
technique  the  modified  RSS  computation  accurately  predicts  measured  TSCT. 

The  results  of  this  preliminary  analysis  of  NAV  system  error  and  FTE 
correlation  are  quite  encouraging.  The  general  aviation  data  investigated 
seems  to  show  a reliable  tendency  (95%  confidence  level)  that  a negative 
correlation  exists.  However',  the  magnitude  of  the  correlation  coefficient 
P|\|P  varies  from  -0.33  to  -0.98.  This  data  scatter  precludes  a firm  recommen- 
dation of  a specific  value  for  Pjjp  at  this  time.  Current  data  analysis  should 
be  expanded  to  include  additional  systems.  Sample  size  (number  of  flights) 
appears  to  have  a direct  impact  on  data  repeatability  with  the  12  flights  per 
route  segment  being  a minimum.  It  does  appear  that  using  a modified  RSS  com- 
putation technique  which  includes  consideration  of  the  correlation  between  NAV 
system  errors  and  FTE  will  improve  the  accuracy  with  which  total  system  cross 
track  error  can  be  predicted.  The  recommended  error  combination  equation  is: 

=0^+0^  + 2p  0 0 

TSCT  NS  FTE  NF  NS  FTE 

In  this  equation  p|\jp  would  be  a specified  constant;  the  value  of  which  has  not 
been  sufficiently  evaluated  at  this  time.  FTE  error  budget  values  or  manufac- 
turer demonstrated  FTE  values  could  be  used  along  with  measured  navigation 
sytem  error  to  reliably  predict  total  system  performance. 
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Figure  3.64 

Correlation  Coefficient  vs.  FTE  (Two-Sigma  in  nm)  for  Miami  and  Denver 
Flight  Test  Programs 
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3.7.4  Airline  RNAV  System  Error  Correlation 


The  type  of  error  correlation  discussed  for  general  aviation  RNAV  systems 
in  Section  3.7.3  does  not  apparently  apply  to  airline  quality  RNAV  systems.  As 
shown  in  Table  3.37  of  that  section,  the  correlation  coefficient  between  navi- 
gation system  errors  and  FTE  was  near  zero,  indicating  no  reliable  correlation 
existed.  This  was  true  for  both  the  Collins  and  the  Delco  flight  test  data. 

This  result  is  not  at  all  surprising  since  there  are  several  additional  levels 
of  filtering  and  smoothing  inherent  in  both  the  RNAV  systems  involved  and  in 
airline  avionics  systems  in  general.  Specifically,  the  VOR  receivers  and  DME 
interrogators  certified  in  conjunction  with  the  Collins  and  Delco  RNAV  computer 
are  generally  of  a higher  quality  than  general  aviation  equipment.  Secondly, 
both  the  airline  RNAV  systems  tested  employ  signal  smoothing  alogrithms  within 
the  RNAV  computer.  Finally,  airline  operations  routinely  provide  a flight 
director.  This  navigation  aid  further  smooths  the  output  guidance  displayed  to 
the  pilot  when  compared  to  the  simple  CDI  or  HSI  deflection  presented  to  the 
general  aviation  pilot.  It  is  for  these  reasons  - more  accurate  receivers,  more 
sophisticated  filtering  and  signal  processing  and  more  complex  displays  - that 
the  simple  correlation  between  navigation  system  errors  and  FTE  does  not  apply 
to  airline  quality  RNAV  systems.  It  is  also  for  these  reasons  that  the  more 
complex  error  combination  equation  is  indicated  to  adequately  sort  out  the  more 
subtle  correlations  involved.  The  equation  to  be  investigated  was  shown  as 
Equation  (6)  in  Section  3.7.2.  This  equation  includes  error  correlation  terms 
for  sensor  and  computer,  computer  and  FTE,  and  finally  between  sensor  and  FTE. 

The  detailed  error  combination  and  correlation  analysis  is  presented  in 
Appendix  B for  the  Delco  RNAV  system.  This  appendix  develops  the  fact  that 
correlations  exist  from  two  viewpoints.  First,  correlation  of  errors  along  a 
given  flight  are  isolated  using  detailed  time  histories  for  seven  autopilot 
flights  in  the  high  altitude  route  structure.  Second,  the  correlation  derived 
from  the  along  flight  statistics  are  substantiated  using  a cross  flight  analysis. 

Referring  to  Appendix  B,  Figures  B.2  through  B.8,  the  following  qualitative 
results  can  be  seen. 

The  first  observation  to  be  made  is  the  repeatability  of  the  radio  (sensor) 
cross  track  error.  This  can  particularly  be  observed  by  comparing  Figure  B.2 
with  Figure  B.4  along  route  J867R  from  ORD-DEN.  For  these  two  flights,  all  five 
traces  are  almost  identical  (a  bias  can  be  observed  in  some  of  the  traces  which 
is  attributable  to  the  INS  reference  track).  The  interesting  factor  is  that 
there  is  a time  span  of  almost  four  months  between  the  two  flights.  Discussions 
with  the  particular  equipment  manufacturers  associated  with  this  flight  test 
indicated  that  the  repeatability  is  very  common  in  all  of  the  data  flights  and 
that  a route  signature  is  discernable  in  many  cases.  This  would  indicate  that 
the  behavior  of  the  radio  measurements  is  predictable  and  hence  the  RNAV  system 
performance  is  predictable  along  a given  route.  This  is  clearly  seen  in  the 
similarities  in  the  total  system  cross  track  error  time  history. 

The  next  observation  to  be  made  is  the  performance  of  the  airline  level 
RNAV  computer.  A comparison  of  the  radio,  computer  and  RNAV  system  cross  track 
error  time  histories  reveals  the  ability  of  this  particular  airline  computer 
to  filter  out  all  but  the  low  frequency  radio  noise.  This  is  particularly 
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noticeable  in  observing  that  the  RNAV  system  error  is  almost  exactly  the  mean 
of  the  radio  error. 

Examine  now  the  FTE  error  trace  in  more  detail.  The  observation  to  be 
made  in  these  figures  is  that  the  FTE  rarely  exceeds  0.4  nm.  In  those  cases 
where  it  does,  evidence  of  severe  scalloping  is  observed.  Even  in  the  case 
of  manual  flight  (first  portion  of  Figure  B.5  prior  to  15  minutes  of  flight) 
the  FTE  magnitude  only  momentarily  reaches  a maximum  of  approximately  1 nm. 

Examination  of  the  radio,  RNAV  system  and  total  system  errors  reveals  the 
final  observation  to  be  made  from  the  error  time  histories.  Note  the  similar- 
ities between  the  RNAV  system  and  total  system  errors.  Except  for  discontinu- 
ities in  the  RNAV  system  error,  which  are  observed  to  be  smoothed,  and  in  the 
total  system  error  due  to  aircraft  dynamics,  the  error  traces  are  almost 
identical.  This  strongly  implies  that  the  total  system  error  is  primarily  due 
to  unfiltered  low  frequency  radio  errors. 

These  qualitative  observations  were  investigated  by  computing  along  track 
flight  statistics  for  these  flights.  The  statistics  are  summarized  in  table 
B.l  of  Appendix  B.  The  indicated  correlation  between  the  RNAV  system  and 
total  system  errors  was  verified  with  a calculated  correlation  coefficient 
greater  than  0.90  for  all  the  flights.  Also,  the  indicated  correlation  be- 
tween the  radio  or  sensor  errors  and  the  RNAV  computer  errors  was  established. 
This  coefficient  varied  from  -0.25  to  -0.72.  Finally,  a correlation  was  indi- 
cated between  the  FTE  measured  and  the  RNAV  computer.  This  coefficient  was 
approximately  0.4  for  all  flights.  The  suspected  correlation  between  FTE  and 
the  sensor  errors  was  not  consistently  verified.  This  coefficient  was  about 
-0.4  for  half  of  the  flights  and  almost  zero  for  the  remaining  half  of  the 
flights. 

In  summary,  the  along  track  time  histories  and  the  along  track  statisti- 
cal aggregations  indicated  similar  trends.  The  results  showed  that  an 
equation  of  the  form: 

=0^  + +0^  + 2p  a a + 2p  a a + 2p  o o (7) 

TSCT  SENS  COMP  FTE  SC  S C CF  C F SF  S F 

where 

p = correlation  coefficient  between  sensor  and  computer  errors 
SC 


p = correlation  coefficient  between  computer  error  and  FTE 
CF 


p = correlation  coefficient  between  sensor  errors  and  FTE 
SF 


may  be  required  in  order  to  adequately  predict  total  system  cross  track  errors. 
Along  track  analysis  indicated  the  psc  ^nd  pCF  correlation  coefficients  may  be 
significant.  Results  regarding  p^p  were  inconclusive. 
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The  estimate  of  two-sigma  total  system  cross  track  errors  over  a series 
of  flights  of  a given  RNAV  system  is  the  desired  goal.  Therefore,  the  Delco 
analysis  was  continued  by  aggregating  statistics  across  three  manual  flights 
using  enroute  data.  Unfortunately,  this  small  sample  size  precludes  utilization 
of  the  statistics  of  reliable  (95%  confidence  level)  estimates.  However,  this 
being  the  only  data  base  available  at  the  time,  it  was  used  to  reinforce  the 
trends  of  error  correlation  noted  during  individual  flights.  Table  3.39  is 
shown  to  document  these  trends. 

In  Table  3.39  the  cross  flight  statistical  data  is  shown  for  three  types 
of  data  editing.  Overall  data  (3)  indicates  all  recorded  data  was  processed. 
Scalloping  Area  (1)  indicates  that  these  are  the  results  obtained  in  the  envir- 
onment characterized  by  VOR  signal  scalloping.  Column  (2)  contains  the  data 
aggregated  from  unscalloped  VOR  regions.  Regarding  the  pSC,  pCF  and  pSF  being 
explored.  Table  3.39  verifies  the  fact  that  correlation  exists  between  the  in- 
dicated variables.  However,  this  table  shows  stronger  correlation  coefficients 
for  other  variable  combinations  such  as  RNAV  system  and  equipment.  Current 
results  can  be  interpreted  to  mean  that  correlations  are  indicated  between 
several  error  sources.  This  means  that  a more  complex  error  combination  compu- 
tation will  be  required  as  indicated  by  the  form  of  Equation  (7).  However,  the 
current  limited  data  base  is  not  sufficient  to  isolate  the  specific  error  sources. 
This  precludes  calculation  and  utilization  of  a limited  number  of  applicable 
correlation  coefficients.  The  error  correlation  analysis  for  airline  quality 
RNAV  systems  will  be  carried  one  step  further  simply  to  illustrate  the  validity 
of  the  current  analytical  approach. 

If  all  of  the  cross  correlation  terms  are  included  in  the  RSS  analysis, 
then  the  computation  of  total  system  cross  track  from  all  the  measured  errors 
will  result  in  an  exact  prediction  of  measured  total  system  error.  That  is, 
the  covariance  terms  are  calculated  using  data  from  the  same  population  that 
was  used  to  obtain  the  total  measured  system  error.  In  other  words,  the  total 
error  must  equal  the  sum  of  the  contributing  parts. 

Table  3.40  summarizes  the  cross  flight  results  for  the  manual  flights. 

The  combination  techniques  of  RSS  and  RSS  modified  by  covariance  terms  are  com- 
pared to  the  recorded  total  system  cross  track  error.  Segregating  the  scalloped 
and  non-seal  loped  regions  as  well  as  combining  them  is  shown  for  comparison. 
Although  this  data  represents  only  three  flights,  the  expected  results  are 
verified.  The  RSS  technique,  including  the  cross  correlation  terms,  predicts 
the  total  system  error  significantly  better  than  using  the  simple  RSS  technique. 
Again,  the  RSS  technique  including  the  covariance  terms  provide  an  exact 
prediction  of  the  total  system  error. 

The  overall  result  of  this  evaluation  of  the  RSS  error  combination  tech- 
nique and  possible  alternatives  has  resulted  in  a better  understanding  of  the 
relationship  between  computed  and  measured  area  navigation  total  system  accuracy. 
The  results  of  this  analysis  have  shown  that  the  RSS  technique  is  overly  con- 
servative for  two  reasons.  First  of  all,  error  correlation  was  identified  be- 
tween FTE  and  other  error  sources  which  invalidates  one  of  the  basic  RSS 
assumptions.  Secondly,  regardless  of  system  type,  system  complexity,  system 
absolute  accuracy,  or  the  navigation  mode  (manual  or  autopilot),  the  flight 
test  results  showed  FTE  to  be  of  the  same  order  of  magnitude  as  TSCT  and  not 
one  half  as  large  as  was  assumed  by  the  Task  Force,  which  precludes  application 
of  the  RSS  error  combination  technique.  When  an  RNAV  system  demonstrated  a 
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Table  3.39 

Summary  of  Cross  Flight  Statistical  Data  Reduction 


ORD— •►DEN 


Cross  Flc. 
2/28, 
(U 

Statistics  of  J867 
6/4,  and  6/12 
(?)  (3) 

FTE 

0.0943 

0.0262 

0.0430 

RNA^' 

0.2427 

-0.2653 

-0.1395 

V 

EQUIP 

-0.0834 

-0. 3526 

-0.2860 

SYSTEM 

0.3371 

-0.2390 

-0.0964 

coni' 

0.3261 

0.0874 

0.1465 

FTE 

0.2234 

0.0907 

0.1390 

RNAV 

0.6781 

0.34'2 

0.5012 

o 

EQUIP 

0.8094 

0.32  34 

0.5035 

SYSTEM 

0.7152 

0. 3710 

0.5402 

CO'-F 

0.5986 

0.2816 

0. 3978 

FTE/RUV 

0.0009 

0.0051 

0.0107 

FTE/EQ 

-0.0618 

-0.0061 

-0.0162 

FTE/SYS 

0,0508 

0.0133 

0.0300 

FTE/COMP 

0.0627 

0.0112 

0.0269 

0 

RNV/EQ 

0.3783 

0.0723 

0.1732 

RNV/SVS 

0.4607 

0.1243 

0.2618 

RNV/COMT 

0.0815 

0.0469 

0.0779 

EQ/SYS 

0.3166 

0.0661 

0.1570 

EQ/COM 

-0.2768 

-0.0324 

-0.0803 

SYS/CO^a' 

0. 1441 

0,0582 

0. 1048 

FTE/RNV 

0.0061 

0.1624 

0. 1531 

FTF/EO 

-0.3416 

-0.2087 

-0.2315 

FTE/SYS 

0.3182 

0 3957 

0. 3993 

FTE/COMP 

0.4688 

0.4389 

0.4859 

p 

RNV/EO 

0.6893 

0.6472 

0.6865 

RNV/SYS 

0.9500 

0.9704 

0.9671 

R.W/COMP 

0.2007 

0.4827 

EQ/SYS 

0.5468 

0.5912 

0.5773 

EQ/COMP 

-0.5714 

-0.3553 

-0.4nne 

SYS/COMP 

0.3367 

0.5567 

0.4R7H 

( 1 ) Seal Inpinf  Area 
(?)  Rrtn.ilnlnp  Area 
(3)  iWerall 
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Table  3.40 


Comparison  of  Error  Combining  Techniques  Across  Flights 


CROSS  FLIGHT 

SYSTEM 

RSS  WITH  ALL 

STATISTICS  OF 

XTRK  ERROR 

COVARIANCE  TERMS 

RSS 

2/28,  6/4,  6/12 

a 

0 

0 

SCALLOPING 

0.715 

0.715 

1.031 

AREA 

(0.715) 

(0.714) 

REMAINING 

0.371 

0.371 

0.438 

AREA 

(0.371) 

(0.357) 

OVERALL 

0.540 

0.540 

0.657 

(0.540) 

(0.520) 

( ) Number  Based  on  opj^  and  Only 


0.3  nm  to  . accuracy,  the  measured  FTE  was  0.2  nm.  Similarly,  when 

an  RNAV  s.  .demonstrated  a 1.5  nm  total  system  accuracy,  measured  FTE  was 
1.4  nm.  As  a result  of  the  similar  magnitudes  of  FTE  and  actual  TSCT,  the 
RSS  technique  computed  estimates  of  TSCT  were  20%  and  35%  conservative  for 
respective  measured  total  system  accuracies  of  0.3  nm  on  the  Collins  system 
and  1.3  nm  on  the  King  system.  This  degree  of  conservatism  was  found  to  be 
acceptable  only  in  the  +2.0  nm  (or  Phase  1)  route  width  environment.  If 
total  system  accuracy  tolerances  are  reduced  and  the  need  for  more  efficient 
airspace  utilization  is  demonstrated,  then  a more  accurate  total  system  error 
computation  should  be  required  for  demonstration  of  RNAV  system  compliance. 

In  anticipation  of  the  requirement  for  a more  accurate  analytical  com- 
putation of  total  system  accuracy,  an  alternative  technique  was  investigated 
which  employed  the  use  of  a correlation  coefficient.  The  correlation  coeffi- 
cent  defines  the  quantitative  relationship  between  two  variables  and  is  then 
included  in  the  error  combination  technique.  Preliminary  analysis  has  shown 
that  a strong  negative  correlation  exists  between  FTE  and  RNAV  system  error 
for  general  aviation,  analog  RNAV  systems.  However,  analysis  of  the  airline 
quality  digital  system  data  did  not  produce  the  same  strong  correlation,  due 
to  limitations  of  the  available  airline  data  and  time  constraints  on  the  analysis, 
the  usefulness  of  the  correlation  coefficient  technique  on  this  level  of  system 
must  be  investigated  further. 


3.8  MINIMUM  RNAV  SYSTEM  WORKLOAD  AND  BLUNDER  CONSIDERATIONS 


The  Miami  and  Denver  operational  flight  test  results  are  discussed  in 
Appendices  C and  D.  The  flight  by  flight  summary  provides  insight  into  the 
magnitude  of  RNAV  system  accuracies  currently  available  as  well  as  RNAV  pro- 
cedural capabilities.  The  system  tested  was  an  analog,  general  aviation, 
single  waypoint,  RNAV  computer  system.  The  major  emphasis  throughout  the  test 
program  was  to  provide  basic  definitive  data  suitable  for  evaluation  of  equip- 
ment performance  in  the  terminal  area.  The  data  applicable  to  anticipated 
protected  airspace  requirements  was  based  on  the  actual  aircraft  position  as 
measured  with  precision  tracking  radar.  Although  the  number  of  flights  per- 
formed was  limited  and  only  one  particular  RNAV  system  was  tested,  the  results 
obtained  from  the  actual  terminal  area  operational  environment  should  indicate 
the  type  of  problems  to  be  expected  with  a single  waypoint  system  in  a high 
density  terminal  area  during  the  early  phases  of  RNAV  implementation. 

The  purpose  of  the  following  discussion  is  to  present  the  data  obtained 
during  these  flights  regarding  the  number,  frequency  and  types  of  procedural 
and  blunder  errors  recorded.  Data  will  also  be  presented  which  documents  the 
time  required  to  sequence  waypoints  using  this  type  of  RNAV  system.  Finally, 
the  impact  of  approach  type  (workload)  on  approach  accuracy  and  FTE  will  be 
discussed. 

For  the  purpose  of  the  error  analysis,  the  following  definitions  were 
uti 1 i zed : 

1)  Blunders  were  defined  as  errors  of  sufficient  magnitude  to 
cause  the  aircraft's  actual  flight  path  to  exceed  the  1977 
airspace  limits  as  defined  by  the  RNAV  Task  Force. 

2)  Procedural  errors  were  defined  as  data  management  or  pilot 
control  errors  noted  during  the  flight  test,  left  uncorrected 
throughout  the  test  but  of  insufficient  magnitude  to  cause 
the  aircraft  to  exceed  the  1977  airspace  limits  as  defined 

by  the  RNAV  Task  Force. 

These  definitions  were  chosen  to  differentiate  between  serious  errors  of 
significant  magnitude  to  cause  unacceptable  aircraft  deviations  from  the  de- 
sired track  and  not-so-seri ous , but  important,  errors  which  must  be  incorpor- 
ated either  explicitly  or  implicitly  into  an  error  budget.  The  blunder  defin- 
ition is  unique  in  that  blunders  were  categorized  by  the  magnitude  of  the  air- 
craft's excursion  relative  to  the  Task  Force  limits.  Table  3.41  summarizes 
these  errors  by  test  number  and  subject  pilot.  It  should  be  noted  that  only 
one  serious  blunder  occurred  during  these  two  experiments.  However,  the  many 
procedural  errors  recorded  are  indicative  of  the  high  cockpit  workload  involved 
with  a single  pilot  flying  a single  waypoint,  minimum  capability  RNAV  system 
in  a high  density  terminal  using  3D  RNAV. 

3.8.1  Procedural  and  Blunder  Errors 

As  shown  in  Table  3.41,  three  subject  pilots  were  utilized  during  the  Miami 
tests  and  two  during  the  Denver  tests.  These  pilots  are  denoted  A,B,  and  C. 
Pilots  A and  B each  had  some  previous  RNAV  experience  (approximately  60  and  300 
hours  respectively).  Pilot  C,  however,  had  never  previously  flown  RNAV.  Table 
3.42  summarizes  the  three  experience  levels. 
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TABLE  3.41  Procedural  and  Blunder  Error  Summary 


1 MIAMI  TERMINAL  AREA  i 

Flight  Sequence 
Number 

Error  Description 

Subject  1 
Pilot  1 

2, 3, 4, 6, 7, 8, 9, 
10,11 ,12,13,14 

None 

A & B i 

1 

11.2°  OBS  setting  error  for  COOPER  W/P 

1 

8.0°  OBS  setting  error  for  MAP  W/P 

! B 

15,16,17,18,19, 
' 20,21 ,22,23,24 

1 

1 

Did  not  sequence  OBS  to  outbound  course  until  after 
waypoint  passage.  Also,  turn  overshoots  resulted 
from  the  subject’s  procedure  of  waiting  for  "To/From" 
indication  prior  to  starting  turn. 

c 

! 

i 15 

Altitude  set  error  of  1400  feet  for  MAP  W/P 

c 

, 17*  1 

1 

i 

i 

Pilot  became  disoriented  and  entered  MAP  waypoint 
prematurely  (forgot  COOPER  waypoint)  resulting  in 
unacceptable  airspace  excursion. 

c ' 

1 

300  feet  high  over  MDA  (700  instead  of  400) 

c 

' 21 

500  feet  high  over  PORTLAND  (2000  instead  of  1500) 

c 

‘ 22 

Did  not  select  proper  CDI  sensitivity  for  SID 

c , 

, 

Initiated  procedural  descent  with  "Fly  Up"  VNAV 
^ indication. 

c 

DENVER  TERMINAL  AREA  1 

4,5,7,8,9,10,12 
1 14,15,16,17,18 

1 None 

A & B 

; 1 

I Forgot  to  input  VNAV  altitude  at  GOLF 

B 

2 

Transposed  W/P  bearing  input  (137.4°  instead  of 
I 134.7°) 

B I 

1 

. - - J 

3 

! Misset  VNAV  altitude  at  GOLF  (8200'  instead  of 
7700')  1 

1 

A 

6 

1 

Did  not  respond  to  VNAV  fly  down  command  prior  to 
PINE  waypoint.  Late  descent  resulted  in  600'  high 
at  O.M. 

A I 

1 

11 

Misset  BYERS  W/P  distance (28.5  nm  instead  of  29.5nm) 

B 

13 

1 

8.2°  OBS  setting  error  for  MAP  W/P 

^ A 

* Blunder  Error 
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TABLE  3.42  Flight  Experience  in  Hours  of  Subject  Pilots 


Subject 

Total 

Multi-Engine 

Instrument 

RNAV 

"A" 

400 

175 

80 

60 

"B" 

2800 

700 

200 

300 

"C" 

6500 

2000 

200 

0 

1 

Subject  "C"  is  primarily  an  air  charter  pilot.  His  performance  reflects 
conventional  air  charter  procedures,  yet  slightly  different  procedures  than  sub- 
jects "A"  and  "B".  Characteristically  he  waited  for  the  CDI  to  indicate  way- 
point  passage  before  sequencing  the  DBS  to  the  outbound  track  and  rolling-in 
to  the  required  turn.  Consequently,  as  shown  in  Table  3.41,  subject  "C"  routinely 
overshot  the  turns.  The  subject's  conventional  procedures  plu*;  typical  utili- 
zation of  shallow  bank  angles  for  passenger  comfort  were  not  compatible  with 
RNAV  requirements  for  procedural  turn  anticipation.  The  repe'table  occurrence 
of  the  turn  overshoots  is  indicative  of  a requirement  for  or- mating  pilots  to 
RNAV  procedures  and  establishing  the  training  required  to  achieve  the  compatible 
turn  performance  desired. 

The  second  largest  category  of  procedural  errors  was  associated  with  3D 
descent  profiles  using  the  VNAV  system.  Procedural  VNAV  errors  were  recorded 
in  both  experiments  for  all  three  subject  pilots.  These  erro.  , included  mis- 
setting  and  forgetting  to  input  waypoint  altitudes  as  well  as  not  responding 
to  VNAV  "fly  down"  commands  or  ignoring  VNAV  "fly  up"  commands.  Errors  in  al- 
titude resulting  from  these  procedural  mistakes  varied  from  500  feet  to  a max- 
imum 1400  feet.  All  of  the  VNAV  descents  were  required  in  the  higher  workload 
base  leg  and  final  approach  route  segments.  The  addition  of  VNAV  input  workload 
in  these  areas,  coupled  with  aircraft  control  and  trim  requirements,  airspeed 
monitoring  for  gear  and  flap  positioning  and  primary  reference  to  indicated 
altitude  during  a descent,  adversely  impacts  the  cockpit  workload.  Either  re- 
vised cockpit  priorities,  a significant  amount  of  VNAV  training  or  a two  crew- 
member requirement  is  indicated  for  VNAV  operations  with  this  type  of  system. 

Other  procedural  errors  included  the  expected  transposition  of  input  digits 
for  rho  and  theta,  neglecting  to  set  the  desired  course  accurately  (8°  to  11° 

OBS  setting  errors)  and  using  the  wrong  CDI  scale  factor. 

The  only  significant  blunder  occurred  during  the  Miami  tests  on  flight  17. 
Figure  C.9,  Appendix  C illustrates  this  airspace  excursion.  In  this  case, 
subject  "C"  became  disoriented  at  FROG  waypoint  and  instead  of  inputting  COOPER 
waypoint,  he  input  the  MAP  waypoint  rho,  theta  and  OBS.  He  then  turned  the  air- 
craft to  the  final  approach  course  heading  and  noticed  a full  fly-right  (greater 
than  5.0  nm)  CDI  indication.  Although  the  pilot  eventually  reoriented  himself 
and  was  able  to  complete  the  approach  successfully,  the  airspace  used  in  re- 
acquiring track  could  have  caused  a conflict  with  downwind  traffic  to  runway  9L. 

3.8.2  RNAV  Input  W or k 

Throughout  the  two  operational  flight  tests,  data  was  acquired  regarding 
the  time  required  to  update  the  RNAV  (p,')  input.  The  single  waypoint  system 
used  had  simple  mechanical  dials  whose  settings  were  selected  by  matching  a 
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number  to  a hash  mark  by  turning  a knob.  Table  3.43  summarizes  the  Miami  in- 
put time  requirements  which  were  typical.  This  table  shows  that  from  13  to 
26  seconds  are  normally  required  with  an  average  time  of  19  seconds  being  re- 
corded for  two  subjects  and  17  seconds  for  the  third  subject. 

The  importance  of  this  17-19  second  (p,fl)  update  workload  is  that,  using 
a single  waypoint  system,  there  is  no  RNAV  guidance  during  this  interval. 

Using  120-180  knots  as  typical  airspeeds  for  terminal  area  operations,  the 
typical  RNAV  aircraft  can  travel  about  1.0  nm  during  the  (p,e)  update.  This 
fact  becomes  more  significant  when  route  width  of  ±1.5  nm  are  being  considered 
(Task  Force  Report  [2],  Phase  2).  This  1.0  nm  without  guidance  also  becomes 
important  when  performing  turns,  sequencing  to  a parallel  offset  track  or  trying 
to  intercept  a STAR  from  an  enroute  course.  During  these  more  critical  naviga- 
tion periods,  the  single  waypoint  system  should  not  be  updated  due  to  the 
possibility  of  course  overshoot.  This  is  especially  true  if  the  (p,e)  update 
requires  a frequency  change  since  additional  time  is  required  to  lock  onto  the 
station.  The  preferred  single  waypoint  RNAV  procedure  would  be  to  fly  in  the 
"FROM"  mode  until  the  turn,  the  parallel  offset  track  acquisition  or  the  STAR 
course  intercept  is  complete  and  the  GDI  indicates  a near  centered  position. 

At  this  time  the  pilot  can  note  the  proper  heading  and  update  the  (p,e)  while 
maintaining  desired  course  with  heading. 

3.8.3  Approach  Workload  Effects  on  FTE 

The  final  workload  element  to  be  considered  is  the  effect  of  approach  type 
on  lateral  FTE.  Both  2D  and  3D  RNAV  approaches  were  flown  with  the  minimum 
capability  RNAV  system  in  the  Miami  tests  while  3D  RNAV  approaches  and  ILS  ap- 
proaches were  flown  at  Denver.  Figures  3.66  and  3.67  present  the  comparative 
results  from  these  two  flight  tests.  During  these  tests  the  RNAV  equipment 
was  located  on  the  lower  part  of  the  pedestal  between  the  pilot  and  co-pilot. 
First  of  all.  Figure  3.66  shows  that  there  is  a significant  35%  (0.14  out  of 
0.40  nm)  increase  in  lateral  FTE  for  3D  (VNAV)  guided  approaches)  compared  to 
the  lower  workload  2D  approach.  Both  of  the  approach  types  showed  a slight 
(0.09R  and  0.12R)  right  of  course  bias  error  indication  (fly  left).  The  Denver 
3D  approach  data  shown  on  Figure  3.67  verified  the  Miami  3D  results.  Lateral 
FTE  from  the  Denver  data  was  ±0.52  nm. 

The  approach  FTE  statistics  support  the  procedural  error  data  of  Section 
3.8.1  which  indicated  a significant  trend  to  input  data  erroneously  during  a 
VNAV  approach.  Although  the  input  errors  were  primarily  associated  with  the 
VNAV  task,  a corresponding  reduction  in  time  spent  monitoring  the  GDI  for  lat- 
eral accuracy  caused  the  increased  FTE  which  was  measured  both  at  Denver  and 
Miami . 

The  approach  data  plotted  in  Figures  3.66  and  3.67  also  offers  an  inter- 
esting insight  into  the  relative  vertical  accuracy  of  tne  three  types  of  ap- 
proaches. Most  obvious  is  the  fact  that  in  both  of  the  guided  descents  (3D 
and  ILS)  the  tendency  was  to  overshoot  the  glideslope  intercept  by  two  to  three 
miles  along  track.  This  resulted  in  vertical  profiles  above  the  desired  slope 
for  both  3D  and  ILS  approaches.  The  maximum  deviation  above  the  ILS  was  1000 
feet  while  the  maximum  3D  deviation  was  1100  feet  both  at  Miami  and  Denver. 

For  the  ILS  approach  this  overshoot  was  quickly  damped  out  by  the  time  the  outer 
marker  was  crossed.  On  the  3D  approaches,  the  profile  continued  above  the  pre- 
programmed 3"  glideslope  for  nearly  the  entire  approach.  However,  in  general, 
level-off  at  MDA  was  achieved  except  for  the  procedural  error  cases  cited  in 
Table  3.41. 
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TABLE  3.43 


WAYPOINT  INPUT  TIMES 
MIAMI  TEST 


lest  no. 

Route 

Pilot 

Tot  ■Input 
Time  (sec.) 

Number  of 
p , 0 updates 

Average  (seconds) 
per  p , 0 updates 

1 

N. RIVER 

B 

51 

3 

17.00 

2 

PIKE 

B 

55 

4 

13.75 

5 

N. RIVER 

B 

46 

3 

15.33 

6 

PIKE 

B 

84 

4 

21  .00 

4(tests) 

236 

14 

16.85 

3 

N. RIVER 

A 

35 

2 

17.50 

4 

PIKE 

A 

67 

4 

16.75 

7 

N. RIVER 

A 

78 

3 

26.00 

8 

PIKE 

A 

63 

3 

21.00 

9 

N. RIVER 

A 

50 

3 

16.67 

10 

PIKE 

A 

63 

3 

21 .00 

1 : 
1 • 

N. RIVER 

A 

54 

3 

18.00 

12 

PIKE 

A 

89 

5 

17.80 

13 

N. RIVER 

A 

46 

3 

15.34 

14 

PIKE 

A 

64 

4 

16.00 

lO(tests) 

609 

33 

18.45 

15 

N. RIVER 

C 

40 

3 

13.33 

16 

PIKE 

C 

83 

4 

20.75 

17 

N. RIVER 

c 

29 

2 

14.50 

18 

PIKE 

C 

no 

6 

18.34 

19 

N. RIVER 

C 

48 

3 

16.00 

20 

PIKE 

C 

73 

4 

18.25 

21 

N. RIVER 

C 

55 

3 

18.33 

22 

PIKE 

C 

100 

5 

20.00 

23 

N. RIVER 

C 

62 

3 

20.66 

24 

PIKE 

C 

75 

3 

25.00 

lO(tests) 

675 

36 

18.75 

Jor  Altitude  (AGL)  Feet 
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Comparing  the  2D  approach  profile  in  the  vertical  plane  to  the  3D  and 
the  ILS  shows  that  procedural  descents  exhibit  a fanning  out  tendency. 

Precise  initiation  of  the  descent  consistently  lagged  glideslope  interception, 
but  attainment  of  the  specified  MDA  occurred  from  0.5  nm  to  2.0  nm  prior  to 
reaching  the  missed  approach  point. 

This  section  discussed  three  area  navigation  workload  related  consider- 
ations. First,  an  analysis  of  the  number,  frequency  and  types  of  procedural 
and  blunder  errors  was  provided.  This  analysis  indicated  the  need  for  well 
defined  RNAV  procedures  for  sequencing  waypoints.  The  number  and  frequency 
of  waypoint  sequencing  errors  substantiated  the  more  quantitative  turn  over- 
shoot analysis  discussed  in  Section  3.2.  The  second  largest  category  of  pro- 
cedural errors  was  associated  with  3D  descent  workload  requirements.  These 
errors  included  missetting  the  waypoint  altitude,  forgetting  to  input  the 
waypoint  altitude  and  not  responding  to  VNAV  guidance  indications.  These  errors 
were  at  least  partially  attributed  to  a fluctuating  (noisy)  VNAV  indicator. 

This  extra  workload  resulted  in  not  only  an  additional  potential  blunder  source, 
but  also  in  an  inflation  of  lateral  FTE  during  3D  descents  and  in  consistent 
overshooting  of  the  desired  VNAV  descent  path.  It  should  be  noted  that  VNAV 
is  not  required  by  ATC  and  when  used,  there  is  no  present  requirement  to  in- 
put all  of  the  charted  waypoints.  Errors  in  actual  altitude  from  550  feet  to 
1400  feet  resulted.  The  VNAV  workload  and  blunder  analysis  dramatically 
illustrates  the  need  for  precise  priorities  and  procedures  in  order  to  accurately 
intercept  a VNAV  glideslope. 

RNAV  (p,9)  input  times  were  also  presented  in  this  discussion.  A nine- 
teen second  update  time  was  typical  with  a 13-26  second  minimum  to  maximum 
variation. 
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3.9  RNAV  EQUIPMENT  CONSIDERATIONS 


Throughout  the  discussion  of  FTE  (Section  3.1)  the  point  was  stressed 
that  CDI  needle  deflections  can  be  caused  by  sources  other  than  the  pilot 
and  that  these  needle  deflections  should  not  be  included  in  FTE  error  budget 
statistics.  This  section  describes  two  equipment  problems  which  directly 
impact  FTE  quantification  as  well  as  the  ability  to  fly  a desired  track 
accurately.  The  first  equipment  derived  problem  has  been  referred  to  as  a 
"From-To"  RNAV  indicated  position  discontinuity.  The  second  equipment 
problem  which  does  not  affect  FTE  magnitudes  but  does  directly  affect  track 
keeping  accuracy  is  the  CDI  calibration  of  volts  vs  nautical  miles.  A third 
equipment  associated  problem  which  does  not  affect  lateral  FTE  will  also  be 
discussed.  This  is  the  tolerance  on  glideslope  angle  specified  for  VNAV 
equipment. 

3.9.1  "From-To"  CDI  Discontinuities 


Although  the  scope  of  the  Denver  and  Miami  flight  test  programs  did  not 
include  the  definition  of  individual  error  components  (error  budgeting) , it 
is  the  purpose  of  this  section  to  document  the  importance  of  an  observed  RNAV 
equipment  induced  error.  The  statistical  test  results  indicate  that  the  re- 
quired Task  Force  (1977-1982)  FTE  limits  of  +1.0  nm  were  essentially  satisfied 
(Table  3.3,  Section  3.1  shows  ±1.05  nm).  Likewise,  it  has  been  shown  that 
the  protected  airspace  requirements  according  to  the  Task  Force  were  met 
for  all  terminal  area  routes  tested.  The  summary  of  the  individual  tests 
(Appendices  C and  D)  documented  the  effects  on  both  FTE  and  protected  airspace 
resulting  from  the  "From-To  Computer  Track  Angle  Discontinuity".  This  par- 
ticular anomaly  occurred  with  most  severity  in  the  Denver  tests  on  the  BYERS- 
FRED  route  segment.  It  has  also  been  documented  on  tests  flown  with  other 
analog  systems.  For  example,  during  previous  flight  tests  at  NAFEC  [8],  this 
particular  anomaly  resulted  in  the  test  aircraft  exceeding  the  protected 
airspace  limits  on  the  FOXTROT-GOLF  segment  6 times  out  of  6 flights  with  dif- 
ferent pilots.  The  data  acquired  thus  far  indicates  that  this  anomaly  seems 
to  be  more  severe  as  the  track  length  between  waypoints  is  increased.  The 
conclusion  to  be  drawn  is  that  the  magnitude  of  the  discontinuity  is  a function 
of  track  length,  and  the  error  is  apparently  angular  in  nature.  Larger  FTE 
values  (CDI  discontinuities)  can  be  expected  when  sequencing  waypoints  on  long 
route  segments.  Also,  this  anomaly  is  apparently  a characteristic  of  analog 
RNAV  systems.  In  both,  the  King  KN  74  analog  system  flight  tests  and  in  the 
NAFEC  test  of  the  Butler  VAC  RNAV  analog  system,  similar  "From-To"  discontin- 
uities have  been  observed  (Figures  3.27-3.30,  Section  3.2). 

The  necessity  to  identify  and  quantify  the  "From-To"  discontinuity  and 
its  relationship  to  FTE  (pilot's  ability  to  fly  the  CDI  needle)  becomes  an 
important  issue  in  the  achievement  of  the  ^1.0  nm  FTE  error  budget  specified 
in  the  Task  Force  (1977-1982)  requirements.  Since,  in  measuring  FTE,  the  pilot 
is  penalized  whenever  a substantial  CDI  deflection  occurs,  it  is  important  to 
differentiate  between  needle  deflections  attributable  to  sources  other  than  the 
pilot.  A detailed  investigation  of  the  magnitude  and  characteristics  of  the 
"From-To"  discontinuity  was  performed  using  the  Miami  test  results. 

Throughout  the  Miami  test  (Appendix  C)  it  became  evident  that  the  presence 
of  a "From-To"  computer  track  angle  discontinuity  was  contributing  to  large  CDI 
deflections.  That  is,  prior  to  RNAV  update  (FROM  mode)  the  CDI  would  indicate 
the  aircraft  to  be  on  the  desired  track.  Once  the  RNAV  update  was  completed. 
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however,  the  CDI  would  indicate  a fly-left  command  up  to  2.0  nm  (2  dots).  The 
BAKER  - FROG  segment  was  the  longest  route  segment  (24.1  nm)  flown  during  the 
Miami  tests.  Of  all  segments  flown  in  the  Miami  terminal  area,  the  BAKER  - FROG 
segment  was  the  one  where  the  "From-To"  track  discontinuity  was  the  largest.  At 
the  conclusion  of  each  RNAV  update  in  this  particular  segment  the  CDI  would  in- 
dicate a fly-left  command  ranging  from  1.0  to  2.0  nm.  This  is  illustrated  on 
Figures  C.l  through  C.24,  Appendix  C.  In  order  to  quantify  the  "From-To"  discon- 
tinuity, Table  3.44  summarizes  conditions  at  the  RNAV  update  of  bearing  (o)  and 
distance  (p)  inputs.  In  the  table  RNAV  updates  are  listed  for  all  segments 
flown.  The  length  of  each  segment  is  shown  with  the  corresponding  test  number. 
Interpretation  of  the  data  is  expedited  by  using  the  following  glossary: 


A ATD 
A TSCT 


A Time 

NAV  Error 

(f) 

NAV  Error 
(t) 

A NAV  Error  - Differential  NAV  Error  Prior  To  and  After  RNAV  Update 

Inspection  of  Table  3.44  indicates  that  the  magnitudes  of  CDI  deflections 
(indicated  RNAV  position)  are  significantly  different  (aCDI  up  to  2.7  nm) 
prior  to  and  after  the  RNAV  (p  , e)  update.  The  table  also  indicates  that  a cor- 
responding increase  in  the  NAV  error  occurs  when  sequencing  waypoints.  Notice 
especially  the  large  aCDI  errors  on  the  BAKER  to  FROG  route  segment  which  occur 
at  24.1  nm  from  the  new  waypoint. 


- Along  Track  Distance  Traveled  While  Performing  RNAV  Update 

- Differential  Total  Cross  Track  (ARTS  III)  While  Performing 
RNAV  Update.  A Gross  Differential  Would  Indicate  a Change 
of  Heading. 

- Time  Differential  Required  To  Update  RNAV. 

- The  NAV  Error  in  the  FROM  Mode  (Total  Cross  Track  Minus 
RNAV) 

- The  NAV  Error  in  the  TO  Mode 


In  contrast  to  the  large  aCDI  and  and  aNAV  errors,  except  for  a very  few 
cases,  the  change  in  total  system  cross  track  error  (aTSCT)  is  relatively  small. 
For  example,  on  the  BAKER  to  FROG  segment  with  consistently  large  "From-To"  dis- 
continuities (0.82  to  2.73  nm),  the  maximum  aTSCT  measured  was  only  0.51  nm  and 
the  average  aTSCT  was  less  than  0.3  nm.  This  is  a strong  indication  that  the 
pilot  acts  as  a good  filter  for  this  type  of  needle  noise.  Specifically,  no  sig- 
nificant airspace  excursions  were  caused  by  the  la>^ge  magnitudes  of  aCDI  observed 
at  waypoint  changeover.  It  is  consistent  then  to  delete  these  large  aCDI  read- 
ings from  the  FTE  statistics  since  not  only  has  their  cause  been  isolated,  but 
the  impact  on  airspace  has  been  minimized  by  proper  pilot  interpretation  of  an 
erratic  guidance  signal. 

This  pilot  filtering  effect  is  dramatically  illustrated  in  Figure  3.68. 

This  figure  shows  a plot  of  the  observed  changes  in  TSCT,  CDI  and  NAV  error  as 
a function  of  along  track  distance.  Careful  examination  of  this  plot  shows  the 
fact  that  TSCT  (the  circles)  changes  at  RNAV  update  were  minimized  regardless 
of  the  along  track  distance  at  which  the  update  was  performed.  In  contrast, 
the  figure  indicates  an  error  increase  on  aCDI  and  aNAV  error  as  a function  of 
ATD.  These  results  indicate  that  the  error  magnitude  of  the  "From-To"  com- 
puter track  discontinuity  is  a function  of  track  length  and  large  FTE  values 
can  be  expected  (if  the  discontinuity  is  not  edited  out)  on  long  route  segments. 
This  anomaly  may  well  be  a peculiarity  of  analog  RNAV  systems.  To  identify  and 
quantify  the  "From-To"  discontinuity  and  its  relationship  to  FTE  (pilot's  ability 
to  fly  the  CDI  needle)  becomes  an  important  issue  in  the  achievement  of  the 
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TABLE  3.44  MIAMI  FTE  FLIGHT  TEST 

FROM  - TO  DISCONTINUITY  AT  RNAV  UPDATE  (RHO/THETA) 
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TABLE  3.44(continued)  MIAMI  FTE  FLIGHT  TEST 

FROM  - TO  DISCONTINUITY  AT  RNAV  UPDATE  (RHO/THETA) 
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From-To  Discontinuity  at  Rf^lAV  Update  (Rho/Theta) 
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two-sigma  repeatability  of  +1.0  nm  FTE  per  Task  Force  (1977-1982)  requirements, 
since  in  measuring  FTE,  the  pilot  is  penalized  whenever  a substantial  GDI  differ- 
ential deflection  (From-To  bias)  occurs. 

3.9.2  GDI  Galibration  Effects 


Another  area  of  interest  regarding  RNAV  equipment  capabilities  is  the  GDI 
calibration  of  volts  vs.  nm.  Significant  GDI  bias  differences  have  been  measured 
between  two  GDI  instruments  that  have  an  effect  on  the  measurable  FTE  and  the 
absolute  tracking  accuracy.  Figure  3.69  shows  the  GDI  calibrations  from  the  two 
instruments.  An  analysis  of  this  data  shows  that  although  both  calibrations  dif- 
fer in  slope  by  only  3mv/mile,  there  exists  an  offset  between  them  by  as  much  as 
0.8  nm  at  the  end  points  and  an  0.6  nm  bias  at  the  0.0  volts  position.  This  means 
that  the  zero  volts  position  on  one  instrument  would  produce  a +0.5  dot  (fly 
right)  indication  while  the  same  zero  volt  position  on  another  instrument  gives 
a very  slight  -0.1  dot  (fly  left)  indication.  This  error  will  not  affect  the 
pilot's  ability  to  fly  a centered  needle.  However,  it  directly  impacts  the  dif- 
ference between  actual  aircraft  track  and  RNAV  indicated  position.  For  example, 
given  the  same  VOR/DME  sensor  errors  (ground  and  airborne)  and  the  same  RNAV 
computer  error,  a centered  needle  position  (0  volts)  would  result  in  a 0.6  nm 
a.  tual  position  difference  for  two  aircraft  each  using  one  of  the  GDI's  shown 
in  Figure  3.69. 

The  reason  for  discussing  this  rather  obvious  point  is  to  emphasize  that 
as  accuracy  tolerances  are  increased,  review  of  manufacturer  equipment  toler- 
ances and  especially  calibration  tolerances  becomes  quita  significant.  Also, 
looking  at  the  above  example  in  a slightly  different  way,  two  pilots  flying  the 
same  course  and  actually  on  course  would  be  credited  with  FTE  budgets  differing 
by  0.6  to  0.8  nm  using  calibrations  such  as  those  indicated.  When  a reduced 
FTE  budget  of  +1.0  nm  is  being  evaluated,  this  becomes  a very  important  point. 

3.9.3  VNAV  Glideslope  Tolerances 

Referring  to  Figures  3.66  and  3.67  of  Section  3.8  illustrates  an  extremely 
important  point  about  30  accuracy.  This  point  is  similar  to  the  GDI  calibration 
problem  just  discussed  in  Section  3.9.2.  That  is,  a nominal  3°  VNAV  glideslope 
was  provided  by  the  VNAV  computer  for  the  Miami  and  Denver  3D  approaches.  This 
nominal  slope  resulted  in  actual  VNAV  descent  data  varying  from  3°  to  5°  due  to 
several  factors.  First,  as  previously  noted,  the  VNAV  needle  was  quite  noisy. 
Second,  the  observation  was  made  that  pilots  tended  to  overshoot  the  3"  glide- 
slope  intercept  and  in  general  fly  a slightly  steeper  gradient.  This  has  been 
attributed  to  the  pilot's  preference  to  have  a "fly  down"  rather  than  a "fly 
up"  indication  during  a descent. 

However,  the  large  effect  of  a small  change  in  computed  glideslope  cannot 
be  ignored.  As  shown  in  the  figures,  a 1°  increase  in  computed  glideslope  from 
3'’  to  4°  produces  an  altitude  discrepancy  of  about  900  feet  at  7 nm  from  the 
Missed  Approach  Point  and  about  500  feet  at  the  Outer  Marker.  The  actual  VNAV 
glideslope  calibration,  therefore,  severely  impacts  the  3D  separation  and 
obstacle  clearance  requirements  associated  with  3D  RNAV  approaches. 

This  brief  presentation  of  three  area  navigation  equipment  associated  prob- 
lems was  presented  to  illustrate  and  reinforce  the  fact  that  all  GDI  needle 
deflections  are  not  classifiable  as  fl ight  technical  error.  The  three  problems 
discussed  do  not  represent  a complete  analysis  of  potential  sources  of  error. 
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These  were  simply  the  three  error  sources  which  became  obviously  significant  as 
the  FTE  data  analysis  progressed.  The  GDI  guidance  discontinuity,  the  GDI  cali- 
bration and  the  VNAV  glideslope  tolerance  are  all  significant  potential  error 
sources  which  must  be  reevaluated  as  route  widths  are  decreased  and  VNAV  becomes 
predominent.  Alternatively,  specification  of  tighter  calibration  tolerances  on 
each  of  these  error  elements  would  contribute  to  even  more  accurate  RNAV  capa- 
bi 1 i ties. 
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4.0  RESULTS 

This  section  summarizes  the  major  results  which  were  presented  and 
analyzed  in  Sections  3.1  through  3.9.  The  organization  of  these  results 
is  by  the  major  issues  which  were  considered  significant  by  the  RNAV  Task 
Force  [2].  These  same  issues  were  specifically  enumerated  in  the  request 
for  work  to  which  this  study  is  a response.  The  issues  are; 

4.1  STEADY  STATE  FTE  MAGNITUDES 

4.2  TURN  ANTICIPATION 

4.3  PARALLEL  OFFSET  OPERATIONS 

4.4  DELAY  FAN  AND  DIRECT  TO  PROCEDURES 

4.5  WAYPOINT  STORAGE  EFFECTS 

4.6  AIRSPACE  UTILIZATION  AND  ACCURACY 

4.7  RNAV  ERROR  COMBINATION  AND  CORRELATION 

4.8  WORKLOAD  AND  BLUNDER  CONSIDERATIONS 

4.9  EQUIPMENT  CONSIDERATIONS 

Each  of  these  issues  is  presented  in  a format  specifically  designed 
for  readability  and  ease  of  interpretation.  Each  of  the  succeeding  sections 
is  contained  on  two  facing  pages.  The  initial  "thesis  sentence"  at  the  top 
of  each  left  hand  page  sets  the  theme  for  the  section  and  establishes  the 
premise  which  is  developed  and  concluded  upon  reaching  the  bottom  of  the 
facing  right  hand  page.  No  section  contains  more  than  two  pages  and  each 
left  hand  page  introduces  a new  subject. 
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4.1  STEADY  STATE  FTE  MAGNITUDES 

To  determine  whether  a one  nautical  mile  flight  technical  error  tolerance 
is  a_ch_i e^ab  1^  jn  ■ -j-oute_  an_d_  termi nal  area  operations  using  each  type  of  air- 
borne  RNAV  equipment. 

The  requirement  for  reduction  of  the  acceptable  flight  technical  error 
tolerance  was  postulated  in  the  Task  Force  Report.  Specifically,  route  width 
restrictions  were  anticipated  as  requirements  in  order  to  accommodate  the 
projected  growth  in  air  traffic.  Decreased  route  widths,  along  with  increased 
utilization  of  the  parallel  offset,  require  a reduction  of  currently  specified 
error  tolerances.  Since  FTE  represented  one  of  the  larger  error  budget  ele- 
ments, it  was  concluded  that  reductions  in  this  error  tolerance  should  be 
investigated. 

Evaluation  of  achievable  FTE  tolerances  was  conducted  in  the  three  air- 
space regimes  of  enroute,  terminal  area  and  final  approach  operations.  The 
wide  spectrum  of  RNAV  systems  from  the  minimum  capability,  single  waypoint, 
analog  type,  to  the  highly  sophisticated,  multiple  waypoint  digital  airline 
type  were  evaluated. 

The  results  of  the  minimum  capability  RNAV  system  (Table  4.1)  demonstrated 
that  the  FTE  capability  resulting  from  the  use  of  this  class  of  system  was  not 
significantly  different  than  the  1.0  nni  FTE  error  budget  suggested  by  the  Task 
Force. 

Table  4.1 

Minimum  Capability  FTE  Tolerances  (Two-Sigma,  95%  Probability) 


MIAMI  TERMINAL  AREA  ~T  1.08  nm  23  Flights 

DENVER  TERMINAL  AREA  1.00  nm  14  Flights 

TOTAL  TERMINAL  AREA  1.05  nm_J  37  Flights 

No  significant  mean  or  bias  errors  were  measured  during  either  the  gen- 
eral aviation  or  airline  flight  test  experiments.  Figure  4.1  is  presented  to 
illustrate  the  fact  that  the  FTE  data  distributions  were  quite  normal  with 
essentially  zero  mean.  Figure  4.2  substantiates  the  statistical  results  ob- 
tained in  Miami  and  illustrates  the  repeatability  of  the  FTE  statistics.  It 
should  be  noted  that,  with  few  exceptions,  the  FTE  data  was  within  the  desired 
‘1.0  nm  FTE  tolerance.  This  illustration  qualitatively  defines  the  meaning 
of  the  two-sigma,  95%  probability  FTE  statistics. 

The  minimum  capability  FTE  statistics  establish  the  lowest  expected  per- 
formance level.  The  current  investigation  included  four  additional  RNAV  sys- 

tems. In  the  airline  system  category,  three  systems  were  tested  which  included 
VOR/DME,  DME/DME  and  INERTIAL  navigation  techniques.  In  the  general  aviation 
tests  a dual  waypoint  analog  RNAV  system  was  tested  in  addition  to  the  minimum 
capability  system  already  discussed.  Both  systems  used  the  VOR/DME  navigation 
mode.  Table  4.2  summarizes  the  measured  FTE  error  limits  established  for  en- 
route, terminal  area  maneuvering,  and  final  approach  operations.  The  detailed 
breakdown  of  the  statistics  summarized  in  Table  4.2  is  discussed  in  Section 
3.1.  Individual  flight  test  results  are  presented  by  RNAV  system  type  in 
Tables  3.3,  3.5,  3.6,  3.7,  3.8  and  3.16  of  that  section. 
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Figure  4.2  Miami  RNAV 

Operational  Tests 
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Figure  4.1  Miami  Flight  Test 

1.0  nm/iot  Sensitivity 


Table  4.2  Demonstrated  Two  Sigma,  95%  Probability  FTE  Limits 


0.  Systems 


1 Airspace  1 

Enroute 

Terminal 

Aooroach 

0.50  nm 

0.34  nm 

0.21  nm 

0.82  nm 

0.90  nm 

0.48  nm 

0.69  nm 

0.74  nm 

0.43  nm 

2.0/1 .0  nm 

1 .0  nm 

0.50 

Phase  1/ 
Phases  2 & 3 

All  Phases 

All  Phases 

RNAv  System 


Airl ine  Systems 
General  Aviation 
All  Systems 

Task  Force 
Requi rements 


These  results  indicate  that  a one  nautical  m 
tolerance  is  achievable  in  level  flight  enroute  and  in  level,  climbinc 


descending  terminal  area  operations  using  various  levels  of  RNAV  equipment  in 
aircraft  types  which  are  typical  of  projected  user  applications.  A 0.5  nm  FTE 
tolerance  is  achievable  for  final  approach. 


4.2  TURN  ANTICIPATION 


I To  determine  the  procedural  or  regulatory  requirements  necessary  to  insure 

C I lateral  separation  between  adjacent  routes  or  tracks  during  turns. 

I Current  RNAV  equipment  handles  turns  in  several  ways.  Some  equipment  re- 

quires flying  the  waypoint  before  turning  to  the  next  leg.  Others  use  auto- 
mated turn  anticipation  and  start  the  turn  sufficiently  in  advance  of  the 
1 waypoint  in  order  to  roll  out  on  the  next  leg  centerline.  Still  others  use  well 

^ defined  procedural  turn  anticipation  techniques. 

. i Current  turn  anticipation  requirements  are  not  consistent.  The  Task  Force 

j suggests  that  turn  anticipation  is  only  required  in  the  autopilot  coupled  mode. 

! The  recent  issuance  of  Advisory  Circular  AC  90-45A  specifies  a procedural  turn 

’ anticipation  technique  for  manual  flying  in  addition  to  "similar  methodology" 

for  autopilot  operations. 

There  is  a definite  need  for  evaluating  turn  performance  and  developing 
procedural  techniques  or  regulatory  requirements.  During  the  current  FTE  in- 
vestigation, turn  performance  was  documented  for  evaluation  of  turn  anticipa- 
tion requirements  for  various  RNAV  systems  in  both  manual  and  autopilot  modes. 
The  following  presentation  summarizes  and  illustrates  the  results  of  the  turn 
performance  evaluation. 

1)  Procedural  turn  anticipation  is  a minimum  operational  requirement. 

' 

Figure  4.3  General  Aviation  Flight  Test  Data 

Procedural  Turn  Anticipation  Turn  Without  Anticipation 


rtcv. 


2)  An  automated  turn  anticipation  light  provided  substantial  reductions  in 
"In-Turn"  tracking  accuracy  for  both  parallel  offset  and  centerline 
tracking.  The  automatic  turn  anticipation  light  should  be  considered 
a valuable  improvement  in  any  RNAV  system  but  not  a required  minimum 
operational  characteristic. 

Table  4.3  Cockpit  Simulator  Turn  Anticipation  Data 


(Two-Sigma,  95%  Probability) 


Tracking  Accuracy 

RNAV  Route 

Parent  Route 

Parallel  Offset 

Combined 

Procedural  Turn  Anticipation 

0.7  nm 

1 . 1 nm 

1.0  nm 

Turn  Anticipation  Light 

0.5  nm 

0.7  nm 

0.7  nm 

4- 


3)  Manual  and  autopilot  flight  test  data  with  a sophisticated,  automatic 
turn  anticipation  technique  demonstrated  acceptable  turn  performance 
in  terminal  area  operations  within  the  current  +2.0  route  width. 


Figure  4.4  Airline  System  Flight  Test  Data 


4)  Turns  without  any  form  of  procedural  or  automatic  turn  anticipation 
resulted  in  severe  overshoots  of  unacceptable  magnitude. 


Figure  4.5  Flight  Test  Data  Without  Anticipation 


Detailed  analysis  of  the  data  typified  by  the  preceding  illustrations  is 
found  in  Section  3.2.  Individual  flight  test  and  cockpit  simulator  results  are 
presented  in  Tables  3.19,  3.21,  3.22  and  3.23  and  in  Figures  3.16  through  3. 30. 
The  overall  results  from  this  evaluation  of  turn  performance  have  demonstrated 
that  a minimum  requirement  exists  for  some  type  of  procedural  turn  anticipatjon 
in-order  to  reduce  turn  overshoots  to  acceptable  levels.  In  addition,  the 
analysis  has  shown  that  using  procedural  turn  anticipation  techniques  elimin- 
ates the  requirement  for  additional  turn  overshoot  airspace  if  the  current 
*2.0  nm  route  width  requirement  is  retained. 
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4.3  PARALLEL  OFFSET  OPERATIONS 


Ip. determine  the  capability  and  operational  applications  of  using  a par- 
a1 1e1  offset  course  to  a parent  route  to  resolve  merging,  passing  and  transi- 
tionin^  tjajfic  problems. 

Parallel  offset  capability  is  an  integral  element  of  the  Task  Force  RNAV 
system  concept.  Current  route  design  criteria,  however,  which  employ  variable 
route  widths  (3.25°  splay  beyond  51  nm  from  the  station)  make  any  operational 
application  of  this  capability  extremely  difficult.  The  Task  Force  recommended 
more  stringent  accuracy  tolerances  (route  widths)  to  meet  a constant  total 
system  cross  track  (TSCT)  error  budget  of  +4.0  nm  enroute  and  +2.0  nm  in  the 
terminal  area  (ultimately  reducing  to  +2.5  nm  and  ±1.5  nm  respectively,  if 
required).  It  was  the  purpose  of  the  current  evaluation  to  explore  the  TSCT 
accuracy  of  flying  parallel  offset  tracks  in  both  an  actual  flight,  and  a 
cockpit  simulator  environment.  Table  4.4  presents  the  results  of  the  airline 
quality  RNAV  flight  tests. 

Table  4.4  Parallel  Offset  Data  for  an  Airline  Type  RNAV  System 

(Two-Sigma,  95%  probability) 


Parent  Route 
A1 1 Offsets 
5 nm  'Offsets 
8 nm  Offsets 

Two  characteristics  of  the  airline  type  RNAV  parallel  offset  data  are 
bliown  in  the  table.  First,  the  magnitudes  of  FTE  and  TSCT  error  are  extremely 
small  for  both  parent  route  and  "All  Offsets"  data.  Second,  there  are  no  sig- 
nificant differences  in  either  FTE  or  TSCT  data  for  manual  or  autopilot  track- 
ing. Both  manual  and  autopilot  data  show  a two  sigma  FTE  of  0.2  nm. 

Figure  4.6  illustrates  the  high  degree  of  track  keeping  accuracy  documented 
in  the  preceding  statistical  summary.  This  plot  also  shows  the  transition 
data  from  the  parent  route  to  the  various  offsets.  The  data  plotted  in  Figure 
4.6  was  derived  from  tracking  radar  and  plotted  for  verification  of  data  re- 
peatability and  identification  of  operational  problems  such  as  the  equipment 
malfunction  noted  on  this  plot. 

The  parallel  offset  FTE  data  obtained  for  get eral  aviation  RNAV  systems 
using  the  cockpit  simulator  generally  substantiates  the  airline  RNAV  system 
results.  Table  4.5  shows  that  there  were  no  significant  systematic  differen- 
ces between  flying  offset  to  the  left  (inside  track)  compared  to  flying  offset 
to  the  right  (outside  track).  The  former  showed  an  average  FTE  of  0.363  nm 
for  5L  and  3L  (inside)  offsets  while  the  5R  and  3R  (outside)  offsets  showed 
an  average  FTE  of  0.349  nm.  Secondly,  Table  4.5  shows  that,  like  the  airline 
data,  no  significant  bias  errors  were  recorded.  Finally,  and  even  more  sig- 
nificant, is  the  fact  that  the  table  shows  FTE  values  were  well  within  accept- 
able limits  for  both  offset  and  parent  route  flying. 


Manaul 

Autopilot 

FTE 

TSCT 

FTE 

TSCT 

0.23  nm 

0.32  nm 

0.19  nm 

0.28  nm 

0.?2  nm 

0.34  nm 

0.21  nm 

0 35  nm 

0.17  nm 

0.28  nm 

0.24  nm 

0.36  nm 

0.26  nm 

0.34  nm 

0.16  nm 

0.32  nm 

4-6 


±2  Sigma 

Mean 

(nm) 

(.nm) 

Total  Aggregate 

Parent 

.288 

.024R 

All  Offsets 

.354 

.020R 

3R  and  3L 

.368 

.024R 

5R  and  5L 

.340 

.016R 

Individual  Offsets 

3R 

.368 

.034R 

3L 

.364 

.009R 

5R 

.330 

.013R 

5L 

.362 

.022R 

Table  4.5  Cockpit  Sinulator  Parallel 
Offset  FTE  Data  (1,2,3 
Waypoint  Storage  Combined) 


Figure  4.6  Parallel  Offset  Radar  Tracks 

For  an  Airline  Type  RNAV  System 


The  acceptability  of  general  aviation  parallel  offset  tracking  accuracy 
was  verified  in  the  operational  tests  performed  at  Denver.  Figure  4.7  illus- 
trates that  acceptable  lateral  separation  was  achieved  on  both  4.0  nm  left 
and  right  parallel  offsets.  These  limited  data  also  defined  potential  problem 
areas  using  a decentered  needle.  These  include  restricted  offset  distance 
(scale  factor),  navigation  system  errors  and  blunder  potential. 


The  overall  analysis  of  parallel  offset  capabilities  is  presented  in 
Section  3.3.  The  analysis  has  shown  and  the  results  summarized  indicate  that 
parallel  offset  operations  are  feasible  from  both  procedural  and  airsp ace 
utilization  considerations. 


Figure  4.7  Parallel  Offset  Radar  Tracks  for  a General  Aviation  RFAV  System 
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4.4  DELAY  FAN  AND  DIRECT  TO  PROCEDURES 


To  determine  the  acceptability  and  utili zation  of  the  Delay  Fan  and 
Direct  To  area  navigation  procedures  from  both  pilot  and  control ler  viewpoints . 

Due  to  the  generally  shorter  route  segments  inherent  in  terminal  area 
operations,  a modified  use  of  the  RNAV  parallel  offset  function  was  suggested 
by  the  Task  Force.  The  term  Delay  Fan  was  used  to  describe  a desired  set  of 
optional  aircraft  tracks  as  shown  in  Figure  4.8. 


Figure  4.8 
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Typical  Area  Navigation  Delay  Fan 
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The  dashed  flight  paths  shown  can  be  used  to  delay  the  arrival  of  aircraft 
(T)  at  waypoint  8 until  aircraft  (2)  has  safely  passed  B.  Similarly,  the  de- 
lay Fan  can  be  used  to  alleviate  overtaking  and  passing  traffic  conflicts. 

The  capability  to  execute  the  Delay  Fan  is  predicated  on  two  RNAV  functions  - 
the  parallel  offset  and  the  Direct  To.  The  utility  of  the  Delay  Fan  procedure 
from  an  ATC  point  of  view  depends  directly  on  the  reliability  and  repeatability 
of  the  RNAV  equipped  aircraft  flight  paths  which  result  from  an  ATC  request  for 
this  type  of  maneuver.  Flight  test  data  regarding  the  RNAV  functional  capability 
as  well  as  the  acceptabi 1 i ty  of  the  resulting  paths  was  obtained  on  both  airline 
and  general  aviation  type  RNAV  systems. 

Delay  Fan  data  using  an  airline  type  RNAV  system  in  both  manual  and  auto- 
pilot modes  is  shown  in  Figure  4.9.  The  shaded  area  indicates  the  theoretical 
airspace  required  using  the  Task  Force  concept.  According  to  this  concept,  the 
reaction  expected  by  a controller  is  for  the  aircraft  to  initiate  a 45°  heading 
change  upon  receiving  an  offset  request.  The  manual  Delay  Fan  profiles  (T)  and 
© illustrate  acceptable  45°  intercept  procedural  capability.  Flowever,  pilot 
procedures  must  stress  the  timeliness  expected  by  the  controller  in  order  to  avoid 
a delay  in  establishing  the  45°  intercept  as  in  © or  establishing  a course  other 
than  45°  and  intercepting  too  early  as  in  ©.  The  autopilot  Delay  Fan  data  il- 
lustrates similar  functional  acceptabi 1 i ty  in  establishing  the  fan  maneuver,  but 
pilot/RNAV  computer/autopi lot  interactions  can  create  unacceptable  airspace  ex- 
cursions as  shown  by  flight  © • The  reasons  for  this  type  of  excursion  are 
thoroughly  explained  in  Section  3.4. 

Delay  Fan  and  Direct  To  data  using  a general  aviation  single  waypoint  RNAV 
system  is  shown  in  Figures  4.10  and  4.11.  The  operational  feasibility  for  a 4.0 
nm  right  offset  followed  by  a Direct  To  COAL  waypoint  is  demonstrated  by  the  air- 
craft track  on  Figure  4.10.  It  should  be  noted  that  the  aircraft  responded  quickly, 
changed  heading  to  the  desired  45°  accurately  and  performed  the  Task  Force  Delay 
Fein  procedure  as  would  be  expected  by  ATC.  Also  the  transition  back  to  the 
parent  route  was  achieved  with  minimum  usage  of  airspace  even  though  the  transition 
Direct  To  COAL  required  a 135"  turn.  These  data  indicate  that  Delay  Fan  procedures 
can  be  performed  using  a minimum  capability  RNAV  system  if  the  pilot  is  properly 
trained. 
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Figure  4.10  Delay  Fan  Data  Using  A 
General  Aviation  RMAV  System 
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Figure  4.11  Direct  To  Data  Using  A 
General  Aviation  RNAV  System 


Figure  4.11  shows  a series  of  3 aircraft  paths  on  which  an  ATC  Direct  To 
maneuver  was  used  for  path  shortening  and  aircraft  sequencing  purposes.  All 
three  flights  were  well  within  the  current  ±2.0  nm  terminal  area  airspace 
1 imits. 

A detailed  discussion  of  Delay  Fan  results  is  presented  in  Section  3.4. 
The  analysis  shows  that  the  feasibility  and  operational  utility  of  the  Delay 
Fain  and  Direct  To  RNAV  maneuvers  are  acceptable.'  However,  p'roper  execution 
of  these  RilAV  maneuvers  requires  a detaTTecTunderstanding  of  area  navigation 
procedures,  timeliness  of  performing  these  procedures,  RNAV  system  operation 
and  ATC  requests.  This  understanding  can  only  be  obtained  through  proper 
orientation  and  training  in  area  navigation  techniques. 


4-9 


4.5  WAYPOINT  STORAGE  EFFECTS 


To  determine  t he  relat i onshi p between  waypoint  storage  capac i ty FTE  an 
cockpit  work  1 ojid . 

The  interest  in  the  impact  of  waypoint  storage  capacity  on  FTE  was  gener- 
ated by  the  Task  Force  assumption  that  a minimum  requirement  for  more  than  one 
waypoint  existed.  In  fact,  the  Task  Force  specified  a minimum  capability  for  * 

at  least  6 stored  waypoints  for  2D  operations  and  10  stored  waypoints  for  3D 
operations.  In  addition,  the  Task  Force  stated  that  cockpit  workload  should 

be  minimized  by  providing  for  simple  manual  insertion  of  waypoints,  impromptu  i 

selection  of  any  stored  waypoint  and  manual  selection  of  a different  waypoint  | 

that  would  not  disturb  the  stored  data.  j 

The  precise  requirements  for  the  storage  of  area  navigation  waypoints 
were  evaluated  with  respect  to  the  impact  on  flight  technical  error  and  pilot 
workload.  In  order  to  fully  understand  the  interaction  of  waypoint  storage 
with  area  navigation  procedural  capability,  a cockpit  simulator  experiment 
was  conducted  to  evaluate  3 levels  of  waypoint  storage,  2 types  of  turn  antic- 
ipation and  2 levels  of  parallel  offset  tracks.  The  data  taken  during  this 
experiment  included  digital  recording  of  FTE  and  manual  recording  of  subject 
pilot  mistakes  or  blunders.  Data  reduction  included  aggregation  of  statisti- 
cal FTE  results  across  flights  and  sorting  these  results  by  major  test  vari- 
able categories.  Additional  data  analysis  was  aimed  at  assessing  the  rela- 
tive acceptability  of  1 , 2 or  3 stored  waypoints  from  a blunder  analysis 
which  was  representati ve  of  system  complexity. 

Table  4.6  presents  the  overview  of  the  cockpit  simulator  waypoint  storage  • 

variation  experiment.  Two  sigma  FTE  variability  errors  are  shown.  No  signif-  i 

icant  bias  errors  were  measured  in  any  of  the  waypoint  storage  categories  for 
the  various  statistical  aggregations  listed.  The  particular  categories  shown 
include:  , 

1)  SID  and  STAR  (Steady  State)  - data  from  all  segments  of  the 

route  tested  except  base  leg  and  final  approach  2 

2)  SID  and  STAR  Comparison  - data  aggregated  by  departure  and 
arrival  segments 

3)  Final  Approach  - data  for  the  last  3 nm  of  the  final  approach 
segment  and  data  for  the  descent  on  base  leg  and  final  approach 

Scanning  this  table  comparing  the  1 wp,  2 wp  and  3 wp  columns  shows  that 
no  appreciable  differences  occurred  in  any  of  the  waypoint  categories  as  far  ? 

as  FTE  reduction  or  inflation  is  concerned.  Although  these  overall  results  1 

indicate  no  appreciable  change  in  FTE  as  a function  of  waypoint  storage,  it  j 

was  felt  that  simple  statistical  aggregation  and  analysis  of  the  aggregates  I 

by  category  did  not  provide  a comprehensive  enough  picture.  Therefore,  the 
University  of  Illinois  performed  a detailed  analysis  of  variance  on  the  same 
set  of  data  (Appendix  A).  The  conclusions  of  both  levels  of  analysis  were 

the  same,  that  is,  no  overall  reliable  differences  in  FTE  were  shown  due  to  j 

the  different  levels  of  waypoint  storage  tested." 
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Table  4.6 


Two  Sigma  FTE  From  Cockpit  Simulator  Tests 


Route  Summary 
FTE 

TWO  SIGMA  FTE 

Total 

Aggregate 

1 wp 

mmmm 

3 wp 

1)  SID  & STAR  (Steady  State) 

0.32  nm 

0.36  nm 

0.50  nm 

0.40  nm 

2)  SID  & STAR  Comparison 

Steady  State  SID 

0.27  nm 

0.25  nm 

0.52  nm 

0.37  nm 

STAR 

0.38  nm 

0.44  nm 

0.49  nm 

0,44  nm 

3)  Final  Approach 

Last  3 nm  Seg  9 

0.30  nm 

0.26  nm 

0.33  nm 

0.30  nm 

Lateral  FTE  during  3D 

(Seg  8 & 9) 

0.52  nm 

0.52  nm 

0.53  nm 

0.52  nm 

In  order  to  assess  the  effects  of  waypoint  storage  on  the  more  qualitative 
aspects  of  the  area  navigation  task  and  of  pilot  workload  in  general,  naviga- 
tion procedural  error  data  was  analyzed  and  a sunmary  of  blunder  count  for  each 
waypoint  storage  capacity  was  generated. 

The  results  of  the  analysis  of  the  blunder  data  recorded  during  this  eval- 
uation of  waypoint  storage  are  presented  in  Figure  4.12.  The  data  on  this 
figure  is  divided  according  to  the  type  of  turn  anticipation  technique  used. 

This  analysis  of  pilot  errors  clearly  shows  that  a significant  reduction  in 
blunders  occurred  for  both  types  of  turn  anticipation  with  a two  waypoint 
system.  The  blunder  analysis  substantiates  the  flight  test  results  quoted  in 
the  avionics  standards  (Reference  [8])  in  which,  util izing  workload  as  a criteria 
for  waypoint  storage  evaluation,  it  was  concluded  that  a single  waypoint  system 
was  not  acceptable.  This  conclusion  was  also  reached  in  the  terminal  area  3D 
and  40  area  navigation  study  [15]. 

_ The  overall  analysis  of  waypoint  storage  effects  indicates  that  a two-way 
point  system  is  preferable  to  a single^ waypoint  system  for  hiqh  density  terminal 
area  operations . . .-.-s! y . 


Figure  4.12 

Waypoint  Storage  Effects 
on  Blunders 


4.6  AIRSPACE  UTILIZATION  AND  ACCURACY 

To  determine  achievable  RNAV  total  system  accuracy  relative  to  specified 
airspace  limits  for  enroute,  terminal  and  approach  airspace . 

The  Task  Force  Report  [2]  anticipated  a need  for  improved  area  navigation 
total  system  accuracies  as  implementation  progressed.  The  present  RNAV  system 
accuracies  and  route  widths  are  defined  in  Handbook  7110.18  and  Advisory  Cir- 
cular AC  90-45A.  The  Task  Force  recommended  retaining  these  specifications 
throughout  Phase  1 (present  to  1977).  However,  starting  in  Phase  2 (1977  to 
1982)  more  stringent  accuracy  standards  will  be  required  to  efficiently  handle 
the  anticipated  growth  in  air  traffic  and  to  increase  the  application  of  par- 
allel offset  routes.  Finally,  in  Phase  3 (post-1982)  the  Task  Force  specified 
additional  improvements  necessary  for  support  of  parallel  routes  enroute  and 
to  keep  pace  with  forecasted  traffic.  The  purpose  of  the  current  study  was 
to  evaluate  whether  the  Task  Force  route  width  tolerances  were  attainable. 

The  assessment  of  achievable  RNAV  total  system  accuracies  was  conducted 
in  the  three  airspace  regimes  of  enroute,  terminal  area  and  final  approach. 

All  levels  of  RNAV  systems  from  the  minimum  capability,  single  waypoint,  analog 
type  to  the  highly  sophisticated  and  accurate  digital,  airline  type  including 
(p,e),  (p,d)  and  inertial  systems  were  evaluated. 

The  results  of  the  minimum  capability  RNAV  system  are  important  in  order 
to  establish  the  basic  performance  which  is  the  least  common  denominator  in 
each  airspace  region.  Table  4.7  presents  a summary  of  the  minimum  capability 
RNAV  total  system  accuracies  demonstrated. 

Table  4.7  Minimum  Capability  RNAV  Total  System  Accuracy 
(Two-Sigma,  95%  Probability) 


Terminal  Maneuvering 

Final  Approach 

MIAMI  Terminal  Area 

0.8  nm 

0.4  nm 

DENVER  Terminal  Area 

1 . 2 nm 

0.6  nm 

Both  Areas  Combined 

1 . 0 nm 

0.5  nm 

The  statistical  results  shown  in  Table  4.7  were  aggregated  across  flights 
on  a route  segment  basis  for  each  RNAV  STAR  flown.  Figure  4.13  is  a typical 
STAR  from  the  Miami  terminal  area  tests. 

Inspection  of  Figure  4.13  substantiates  the  conclusion  indicated  by  the 
results  of  Table  4.7  that  the  minimum  capability  RNAV  total  system  accuracy 
is  well  within  the  current  airspace  utilization  limits. 

The  minimum  capability  total  system  accuracy  establishes  the  expected 
performance  level.  The  current  evaluation  included  3 airline  quality  type 
systems  and  an  additional  two  waypoint,  analog  general  aviation  system.  Table 
4.8  summarizes  the  results  from  the  aggregation  of  actual  aircraft  track  data 
for  the  two  levels  of  systems  tested.  The  detailed  breakdown  of  the  statistics 
suimarized  in  Table  4.8  is  discussed  in  Section  3.6.  Individual  results  are 
subdivided  by  system  tested  in  Tables  3.31,  3.32,  3.33  and  3.34. 
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Task  Force 
Requirements 
Implementation 
Phase 


1.14  nm 


4.0  nm 
splayed 


/4.0  nm  /2.5  nm 
/ const/  const 


1/  2/ 


0.75  nm  0.25  nm 

1.22  nm  0.47  nm 

2. 0/1. 5 0.9/0. 8/0. 6 

(nm)  (nm) 

1/2,3  1/  2/  3 


These  results  indicate  that  achievable  RNAV  total  system  accuracies  are 
within  current  and  anticipated  airspace  limits  for  enroute,  terminal  and  final 


4.7  RNAV  ERROR  COMBINATION  AND  CORRELATION 


To  determine  the  accuracy  and  a^pjjcabi  1 i ty  oT_  the  Root-Sum-Sj^uare  error 
combination  technique  for  calculating  area  navigation  total  jystem  ac^uracy_. 

The  Task  Force  Report  discusses  accuracy  tolerances  required  of  RNAV  equip- 
ment in  order  to  achieve  compatibility  with  postulated  route  width  requirements. 
The  total  system  error  which  must  be  demonstrated  consists  of  ground  and  air- 
borne sensor  errors  (primarily  VOR/DME),  RNAV  computer  error  and  flight  tech- 
nical error.  These  errors  are  assumed  to  be  independent,  non-correlated  and 
normally  distributed  such  that  they  may  be  combined  by  the  conventional  Root- 
Sum  Square  (RSS)  technique.  Presumably,  the  RSS  technique  will  be  used  as  an 
acceptable  computation  technique  for  RNAV  system  demonstration  of  compliance 
throughout  all  phases  of  RNAV  implementation.  However,  the  results  of  the 
current  analysis  indicate  that  this  error  combination  technique  may  be 
unnecessarily  conservative  in  predicting  total  system  errors  from  measured  error 
budget  components.  In  addition,  the  projected  increase  in  air  traffic,  which 
was  the  impetus  for  the  improved  accuracy  tolerance  (reduced  route  widths), 
warrants  a more  accurate  knowledge  of  total  system  capability  than  the  RSS 
computation  can  provide. 

The  current  study  utilized  data  from  both  airline  and  general  aviation 
type  area  navigation  systems.  Figure  4.14  illustrates  schematically  the  re- 
sults from  a comparison  of  the  computed  RSS  total  system  cross  track  (TSCT) 
error  with  the  measured  total  system  error  obtained  from  radar  tracking.  It 
can  be  seen  that  the  RSS  technique  resulted  in  computed  TSCT  errors  35%  larger 
than  measured  at  an  RSS  value  of  2.0  nm  and  33%  larger  than  measured  at  an  RSS 
value  of  1.5  nm.  The  actual  flight  test  data  from  which  Figure  4.14  is  de- 
rived was  shown  in  Section  3.7,  Figure  3.63.  Stated  another  way.  Figure  4.14 
shows  that  when  the  RSS  computation  indicated  the  flight  tested  RNAV  system 
was  capable  of  operation  within  *2.0  nm  two  sigma  route  widths  on  a 95%  prob- 
ability basis,  the  actual  measured  TSCT  accuracy  was  *1.3  nm.  Similarly,  at 
a computed  TSCT  of  *1.5  nm,  measured  TSCT  was  *1.0  nm.  It  can  be  seen  that 
the  RSS  error  combination  technique  is  much  too  conservative  to  be  compatible 
with  reduced  route  width  requirements.  Although  currently  the  *2.0  nm  route 
width  and  the  RSS  error  combination  technique  are  used  successfully  for  air- 
space planning  and  RNAV  system  certification,  if  traffic  demand  does  warrant 
reduced  route  widths,  then  a more  accurate  knowledge  of  RNAV  total  system  per- 
formance is  required  for  both  efficient  airspace  planning  and  compatible  sys- 
tem certification  requirements. 

The  reasons  for  the  conservatism  of  the  RSS  computation  are  primarily  that 
the  error  sources  are  not  uncorrelated  and  independent.  Statistical  analysis 
of  the  airline  and  general  aviation  RNAV  flight  test  data  has  shown  that  error 
correlation  coefficients  significantly  greater  than  zero  can  be  reliably  com- 
puted for  several  of  the  error  sources.  As  a first  approximation  to  an  im- 
provement in  the  RSS  computation  the  following  approach  was  developed.  By  de- 
fining navigation  system  error  as  the  net  effect  of  RNAV  computer  and  all 
ground/airborne  sensor  errors,  the  modified  RSS  computation  becomes: 

t’"  = + 2p  cr  0 

TSCT  NS  FTE  NF  NS  FTE 

where  = navigation  system  error  including  sensor  inputs  and  computer 


Measured  Total  System  Cross  Track  Error  - nm 


Figure  4.14  Comparison  of  Computed  and  Measured  TSCT  Data 
= Flight  Technical  Error 

'^[^p  = The  correlation  coefficient  between  navigation  system  error  and 

FTE.  (see  Section  3.7.2  for  calculation  procedure). 

From  the  test  data,  a preliminary  value  of  P^^p  of  -0.7  was  derived  for  use  with 
general  aviation  RNAV  equipment,  p^jp  for  airline  type  equipment  did  not  show 
such  a strong  negative  correlation  and  further  analysis  of  additional 
data  is  required  for  this  category  of  RNAV  system. 


Figure  4.15  Comparison  of  Computed  and  Measured  TSCT  Using  a Nominal 
Correlation  Coefficient 


The  RSS  error  combination  techni que  i s^  too  cons e ry^t i ve  to  be  comp a t jbje 
with  the  requirement  to  demonstrate  improved  total  system  accuracy  in  ordery^ 
be  compatible  with  reduced  route  widths.  If  and  when  the-need  for  reduced 
route  width  is  demonstrated,  the  RSS  error  combination  technique  must  be  re- 
placed with  a more  accurate  method. 
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4.8  WORKLOAD  AND  BLUNDER  CONSIDERATIONS 


primary  RNAV  workload-related  procedures  which  can  lea_d 
to  serious  b 1 under  e r r or s_. 

A concern  for  pilot  workload  associated  with  the  manual  insertion  of  way- 
point  data  was  expressed  in  the  Task  Force  Report.  The  purpose  of  the  workload 
and  blunder  analysis  performed  in  this  study  was  to  identify  the  primary  RNAV 
procedures  affected  by  RNAV  and  VNAV  input  workload.  In  addition,  the  approx- 
imate waypoint  update  input  time  required  was  quantified  on  a minimum  capability 
single  waypoint  RNAV  system. 

The  primary  source  of  the  2D  procedural  error  data  was  from  flights  with 
a subject  pilot  having  6500  total  flight  hours,  2000  multi-engine  hours  and  200 
actual  instrument  hours  but  who  had  never  previously  flown  RNAV.  His  perform- 
ance should  be  representative  of  a typical  RNAV  user  group.  It  reflects  con- 
ventional air  charter  procedures  which  are  not  necessarily  compatible  with  RNAV 
operational  or  accuracy  requirements.  After  classroom  RNAV  instructions  and 
a one  hour  orientation  flight  this  subject  flew  10  experimental  flights.  He 
consistently  overshot  turns  of  45°  to  91°  heading  change.  Characteristically, 
he  waited  for  waypoint  passage  before  sequencing  to  the  next  waypoint.  Conse- 
quently, the  delayed  roll-in  to  the  required  turn,  coupled  with  the  subject's 
normal  utilizat  on  of  shallow  bank  angles  for  passenger  comfort,  were  not  com- 
patible with  RNAV  turn  airspace  requirements.  As  shown  in  Table  3.41,  Section 
3.8,  the  turn  performance  of  this  subject  was  unacceptable  on  all  10  flights. 

The  repeatable  occurrence  of  turn  overshoots  is  indicative  of  a requirement 
for  orienting  pilots  to  RNAV  procedures  and  establishing  the  training  required 
to  achieve  the  compatible  turn  performance  desired. 

The  RNAV  input  workload  associated  with  VNAV  descents  was  the  second  ser- 
ious cause  of  procedural  errors.  Data  from  37  flights  using  three  different 
subjects  (see  Table  3. 41). showed  consistent  VNAV  input  errors.  The  extra  work- 
load associated  with  VNAV  descents  also  led  to  a degradation  in  lateral  navi- 
gation accuracy  and  consistent  overshooting  of  the  desired  VNAV  descent  profile 
(3°).  Figure  4.16  illustrates  the  data  bandwidth  for  12  VNAV  approaches.  VNAV 
procedural  errors  included  missetting  and  forgetting  to  input  waypoint  alti- 
tudes as  well  as  not  responding  to  VNAV  fly  down  commands.  Maximum  altitude 
deviation  from  the  desired  glideslope  was  1100  feet.  Lateral  FTE  was  *0.54  nm 
on  the  VNAV  approaches  compared  to  *0.40  nm  on  12  two  dimensional  RNAV  approaches 
over  the  same  course. 

The  most  significant  airspace  excursion  occurred  due  to  pilot  disorienta- 
tion and  early  input  of  the  missed  approach  waypoint.  Although  the  pilot  event- 
ually reoriented  himself  and  successfully  completed  the  approach,  the  airspace 
required  for  this  maneuver  was  not  acceptable. 

As  shown  in  Section  3.8.2,  Table  3.43,  the  average  time  for  RNAV  (.  , ) in- 
put was  19  seconds.  Variations  from  13  to  26  seconds  occurred  due  to  the 
different  types  of  approaches  mentioned,  different  communications  workload, 
weather  and  traffic.  At  the  airspeed  tested,  this  corresponds  to  about  1 nm 
distance  traveled,  which  is  significant  in  terminal  area  operations  where 
route  widths  are  only  *2.0  nm. 


r 


3D  RNAV  APPROACHES  (12) 


Figure  4.16  Lateral  FTE  for  2D  vs.  3D  Approaches 


The  overall  analysis  of  the  workload  and  blunder  data  illustrates  the 
need  for  _w_eJJ  defined  RNAV  procedures  for  sequencing  waypoints  and  when 
performing  VNAV  descents . 
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4.9  EQUIPMENT  CONSIDERATIONS 


To_ determine  and  cLuantjfy  specific  RNAV  e_quippient_  related  problems  which 
can  dj rectly_  impact  flipht  technical  error. 

The  Task  Force  Report  expressed  concern  for  RNAV  equipment  functional  and 
accuracy  capabilities.  Equipment  functions  and  accuracy  tolerances  were  speci- 
fied for  all  three  phases  of  area  navigation.  Explicitly  included  in  this 
specification  were  RNAV  computer  and  display  variables  which  could  adversely 
affect  FTE.  However,  the  Task  Force  did  not  mention  the  implicit  equipment 
characteristics  and  tolerances  which  can  also  directly  affect  FTE.  Although 
the  specification  of  individual  mechanical  error  tolerances  was  probably  outside 
the  scope  of  the  Task  Force  effort  and  is  similarly  outside  the  scope  of  this 
document,  three  significant  mechanical  error  tolerances  were  noted  which  are 
directly  related  to  RNAV  performance  and  FTE,  therefore,  it  was  decided  to  in- 
clude a brie  discussion  of  these  elements.  This  discussion  comprises  Section 
3.9  and  the  main  findings  are  summarized  in  the  following  results. 

Throughout  the  discussion  of  FTE,  the  point  was  stressed  that  GDI  needle 
deflections  can  be  caused  by  errors  other  than  the  pilot's  and  that  these  types 
of  needle  deflections  should  not  be  included  in  FTE  error  budget  statistics. 

One  typical  error  of  this  type  was  observed  repeatedly  in  the  evaluations  of 
both  the  single  and  dual  waypoint,  analog,  general  aviation  RNAV  systems.  This 
error  has  been  called  the  "From-To"  RNAV  discontinuity.  This  discontinuity 
was  characterized  by  a large  change  (1  to  3 nm)  in  RNAV  indicated  position 
(GDI  deflection)  while  holding  heading  and  updating  the  RNAV  (p,e)  inputs. 

Radar  tracking  data  during  this  same  time  generally  showed  only  minor  varia- 
tions in  actual  aircraft  position.  Typical  results  are  shown  in  Table  4.9 
for  changes  in  total  system  cross  track  (aTSGT)  and  changes  in  RNAV  indicated 
position  (aGDI)  as  a function  of  along  track  distance  from  the  "To"  waypoint. 
This  table  is  a condensation  of  Table  3.44,  Section  3.9.1.  The  "From-To"  dis- 
continuity is  apparently  angular  in  nature.  Gonsequently , even  larger  values 
can  be  expected  when  sequencing  waypoints  on  long  route  segments  such  an  en- 
route. 


Table  4.9  RNAV  "From-To"  Discontinuity  Effects 


Along  Track 
Distance 

aGDI 

aTSGT 

7 

0 

nm 

0 

36 

nm 

0 

CO 

o 

nm 

8 

2 

nm 

0 

96 

nm 

0 

11 

nm 

9 

2 

nm 

1 

44 

nm 

0 

04 

nm 

10 

1 

nin 

1 

69 

nm 

0 

67 

nm 

13 

6 

nm 

1 

24 

nm 

0 

23 

nm 

22 

5 

nm 

0 

08 

nm 

0 

07 

nm 

24. 

1 

nm 

2 

73 

nm 

0. 

51 

nm 

The  magnitude  of  these  needle  deflections  illustrates  the  importance  of 
di fferentiating  between  needle  deflections  attributable  to  sources  other  than 
the  pilot.  It  is  significant  to  note  that  the  corr-. jponding  magnitudes  in 
aTSGT  are  much  smaller  and  do  not  exhibit  the  angular  dependency.  This  verifies 
that  pilots'  previous  instrument  training  has  taught  them  to  differentiate 
between  good  and  bad  displayed  data. 
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Another  significant  RNAV  equipment  error  source  is  the  GDI  display  calibra- 
tion tolerance.  The  GDI  calibration  of  volts  versus  dots  deflection,  or  volts 
versus  nautical  miles,  will  not  affect  the  pilot's  ability  to  fly  a centered 
needle.  However,  this  error  directly  affects  the  navigation  system  error, 
that  is,  the  difference  between  actual  aircraft  position  and  RNAV  indicated 
position.  Based  on  a sample  of  two  typical  GDI  instruments,  differences  of 
up  to  0.6  nm  can  currently  occur  at  the  zero  volts  position.  This  means 
that  for  the  same  VOR/DME  sensor  errors,  and  the  same  computer  error,  a cen- 
tered needle  (0  volts)  would  result  in  a 0.6  nm  actual  position  difference 
between  two  aircraft.  This  is  greater  than  25%  of  the  allowable  terminal 
area  route  width. 

Similar  calibration  errors  could  exist  in  computed  VNAV  glideslope. 

Figure  4.16,  Section  4.8  shows  that  a 1°  increase  in  computed  glideslope 
(3°  to  4°)  produces  an  altitude  discrepancy  of  about  500  feet  at  the  Outer 
Marker. 

Each  of  the  three  equipment  problems  discussed,  directly  affect  RNAV 
accuracy.  As  route  widths  are  decreased  and  the  use  of  VNAV  becomes  common- 
place, the  allowable  tolerance  these  three  items  should  be  re-evaluated. 
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5.0  CONCLUSIONS 

The  major  conclubions  from  this  analysis  of  flight  technical  error  are 
briefly  summarized  here  according  to  the  previously  stated  major  FTE  issues. 

Steady  State  FTE  _Magn i tud£ 

A one  nautical  mile  f light  technical  error  tolerance  i s achievable  i n level 
flight  enroute  and  level,  climbing  and  descending  terminal  area  operations  using 
various  levels  of  RNAV  equipment  in  aircraft  types  which  are  typical  of  user 
applications.  A 0.5  nm  FTE  tolerance  is  achievable  for  final  approach.  (Tables 
3,3  and  4.2). 

• FTE  remains  an  important  error  budget  element  for  the  design 
and  utilization  of  airspace  and  the  specification  of  RNAV 
procedures . 

• The  magnitude  of  FTE  in  enroute,  terminal  and  approach  airspace 
was  found  to  be  within  both  current  AC  90-45A  limits  and  the 
Task  Force  error  budget  tolerances. 

• Both  manual  and  autopilot  FTE  data  for  airline  type  RNAV  systems 
indicate  that  an  FTE  tolerance  of  less  than  one  nautical 

mile  is  achievable  in  both  the  enroute  and  terminal  areas. 

• FTE  data  on  minimum  capability  RNAV  systems  was  not  reliably 
different  from  the  1.0  nm  FTE  budget  recommended  by  the  Task 
Force  for  both  enroute  and  terminal  area  applications. 

• Qualitative  analysis  of  FTE  data  has  shown  that  although  some 
pilots  filter  out  small  CDI  needle  deflections  (less  than  1.0 
nm)  and  hold  heading  while  other  pilots  respond  to  the  small 
deflections  (on  the  order  of  0.5  nm)  and  tend  to  "chase  the 
needle",  both  techniques  result  in  acceptable  FTE  performance 
within  the  one  nautical  mile  error  budget  tolerance. 

• The  impact  of  data  editing  to  obtain  steady  state  statistical 
results  was  shown  to  produce  the  desired  results  without  sig- 
nificantly affecting  the  mean  or  the  basic  normal  distribution 
of  the  data. 

• The  use  of  differing  display  sensitivities  (0.1  to  1.0  nm/dot) 
during  cockpit  simulator  testing  for  linear  course  deviation 
had  no  measureable  effect  on  pilot  steering  performance. 

t No  significant  FTE  differences  appeared  between  the  linear  or 
angular  display  configuration. 

• No  significant  FTE  differences  occurred  between  the  HSI  or 
CDI  tested. 

Turn  Anti£ipation 

A minimum  requiren^nt  exists _fo_r_  some  t^pe  of  procedural  turn  anticipation 
in  order  to  reduce  turn  overshoot's  to  acceptable  levejs.  In  addition,  the 
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analysis  has  shown  that  using  procedural  turn  anticipation  techniques  eliminates 
the  requirement  for  additional  turn  overshoot  airspace  in  terminal  area  opera- 
tions ij[  the  current  '2.0  nm  route  width  requirement  is  retained.  (Figures 
3.22  to  3.24). 

• Procedural  turn  anticipation  decreases  the  magnitude  of  turn 
overshoots  to  acceptable  levels. 

• Improved  turn  performance  was  demonstrated  using  an  automated 
turn  anticipation  warning  light  compared  to  procedural  antic- 
ipation. However,  the  warning  light  is  not  required  as  a 
minimum  equipment  characteristic. 

• lack  of  turn  anticipation  of  any  type  results  in  severe  over- 
shoots (up  to  3 nautical  miles)  which  are  not  acceptable  in 
an  RNAV  airspace  environment. 


Parallel  Offset 

The_ operational  feasibility  of  parallel  offset  operations  was  demonstrated 
on  3,  5 and  8 nm  offsets  using  digital  P.NAV  systems  and  a parallel  offset 
function  which  prov ided  a centered  needle  indication  when  the  offset  was  prop- 
erly acquired.  (Tables  4.4  and  4.5,  Figures  3.33  to  3. 35) 

Limited  parallel  offset  data  using  a decentered  needle  to  maintain  a 
procedural  offset  was  also  obtained.  Potential  problem  areas  with  limited 
offset  distance  (scale  factor)  and  navigation  system  errors  may  preclude  the 
acceptability  of  this  type  of  parallel  offset  capability. 

• No  differences  in  FTE  tolerance  limits  or  airspace  utiliza- 
tion were  measured  using  an  airline  type  RNAV  system  with  a 
centered  needle  parallel  offset  function  on  5 and  8 nm  right 
and  left  offsets  when  the  data  was  compared  to  parent  route 
tracking. 

t Using  an  airline  type  RNAV  system,  no  significant  differences 
in  either  FTE  or  airspace  utilization  were  noted  for  manual 
vs  autopilot  parallel  offset  tracking. 

• FTE  data  obtained  using  a less  sophisticated  general  aviation 
type  RNAV  system  with  a centered  needle  parallel  offset  func- 
tion, generally  substantiates  the  airline  RNAV  system  results. 
There  were  no  significant  differences  between  flying  offset 

to  the  left  or  right  compared  to  flying  the  parent  track.  The 
former  showed  an  average  FTE  of  0.363  nm  for  5L  and  3L  (inside) 
offsets  while  the  5R  and  3R  (outside)  offsets  showed  an  aver- 
age FTE  of  0.349  nm.  Secondly,  like  the  airline  data,  no  sig- 
nificant bias  errors  were  recorded.  Finally,  and  even  more 
signi*i.ant,  is  the  tact  that  the  FTE  values  were  well  within 
acceptable  limits  for  both  offset  and  parent  route  flying. 

• Parallel  offsets  of  up  to  4 nm  were  tested  using  a minimum 
capability  RNAV  system  and  a procedural  technique  of  flying 
a decentered  display  needle.  Although  this  technique  is 
possible,  practical  limitations  of  the  display  scale  factor 
may  not  be  compatible  with  required  ATC  offset  recjui  roments . 
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In  addition,  preliminary  data  suggests  that  navigation  system 
errors  may  cause  the  actual  aircraft  offset  track  to  be  sig- 
nificantly different  from  the  displayed  offset  position  in- 
dicated by  the  CDI  needle  used  for  guidance  by  the  pilot. 

DeJ Fan  a n^  re  c t T q_  P r oced  u r^ 

Th^  feasibility  and  operational  utility  of  the  Del ^ Fan  and  Direct  To 
RNAV  maneuvers  were  acceptably  demonstrated  for  both  airline  and  general 
aviation  RNAV  systems.  (Figures  4.9  and  4.10). 

• In  the  manual  mode  using  an  airline  type  RNAV  system,  the 
functional  capability  to  perform  a Delay  Fan  terminated 
by  a Direct  To  command  is  acceptable.  However,  RNAV  pilot 
procedures  must  be  developed  which  stress  the  timely  re- 
sponse in  implementing  and  achieving  the  Delay  Fan  which 
is  expected  by  ATC. 

• In  the  manual  and  autopilot  modes  a precise  knowledge  of  the 
desired  response  expected  by  ATC  is  necessary  to  ensure 
accurate  and  efficient  utilization  of  the  Delay  Fan.  In  the 
coupled  mode  in  particular,  system  complexity  requires  an 
even  greater  understanding  of  the  interactions  of  RNAV  hard- 
ware, software  and  stored  data  with  autopilot  functions  to 
ensure  that  each  RNAV  system  performs  the  Delay  Fan  in  a con- 
sistent manner  as  required  by  the  controller.  During  current 
tests,  interacting  problems  with  software,  previously  stored 
data  and  automated  turn  anticipation  caused  unacceptable 
deviations  from  the  desired  Delay  Fan  procedure  when  operating 
in  the  coupled  mode. 

• Direct  To  and  Delay  Fan  procedures  using  a general  aviation 
type  RNAV  system  were  acceptable. 

RNAV  Training  Requi reme n t s 

Navigation  procedures  unique  to  RNAV  indicate  the  need  for  comprehens've  ' 

pilot  fami  1 ia>^izatjon  and  trainjn^. 

• The  utilization  of  procedural  turn  anticipation  and  the  means 
of  implementation  should  be  a specific  RNAV  training  require- 
ment. 

• Parallel  offset  operations  and  the  specific  parallel  track  * 

acquisition  and  return  to  parent  track  procedures  require  ) 

additional  pilot  training  to  achieve  consistent  performance  - 

of  these  maneuvers. 

• Delay  Fans  and  Direct  To  RNAV  maneuvers  require  additional 
training  which  defines  the  desired  track  and  the  required 
cockpit  procedures  in  order  to  assure  compatible  operations 
for  all  levels  of  equipment  sophistication. 

• A significant  reduction  in  overall  blunders  as  well  as  a 
significant  improvement  in  procedural  accuracy  occurred 
over  the  first  three  to  five  RNAV  flights  by  each  ex(>eri- 
mental  subject  pilot.  This  is  indicative  of  the  preliminary 
minimum  flight  training  and  procedural  familiarization 
requi remen ts . 
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W aypoint  Storage 


No  reliable  flight  technical  error  differences  were  measured  for  1 , 2 or 
3 waypoint  storage  capability.  However,  workload  and  blunder  frequency  data 
indicate  a two  waypoint  system  is  preferable  t£  a single  waypoint  system  for 

pns.  {Table  4.6  and  Figure  4.12). 

• From  an  accuracy  viewpoint  (FTE  and  Total  System  Cross  Track 
error),  no  reliable  differences  were  measured  for  1 , 2 or  3 
stored  waypoints. 

• The  functional  capability  for  terminal  area  maneuvering  was 
no  different  using  a 1 , 2 or  3 waypoint  RNAV  system.  Oper- 
ations on  prefiled  SIDs  and  STARs,  parallel  offset  operations, 
VNAV  descents  and  final  approach  operations  were  successfully 
performed  by  1 , 2 or  3 waypoint  systems.  Although  increases 
in  FTE  were  observed  during  the  various  operations  mentioned 
(e.g.,  parallel  offsets),  there  were  no  consistent  differences 
in  FTE  for  1 , 2 or  3 stored  waypoints  during  any  of  the  ter- 
minal area  maneuvers. 

• From  a workload  and  blunder  frequency  viewpoint,  both  simulator 
and  flight  test  data  indicate  that  a two  waypoint  system  is 
preferable  to  a single  waypoint  system  for  terminal  area  oper- 
ations . 

Airspace  Utilization  and  Accuracy^ 

RNAV  total  system  accuracy  is  within  current  specified  horizontal  pro- 
tected airspace  limits  for  enroute,  terminal  ^nd  approach  airspace.  fTables 
4.7  an¥  4.8K 

• Flight  test  results  using  various  levels  of  RNAV  equipment 
in  aircraft  types  typical  of  user  applications  show  that 
current  AC  90-45A  horizontal  total  system  error  tables  can 
be  satisfied. 

t The  Task  Force  and  AC  90-46A  assumption  of  essentially  a 
zero  mean  error  for  steady  state  horizontal  operations  was 
substantiated  when  a statistically  significant  number  of 
flights  were  aggregated. 

• Test  results  for  airline  type  RNAV  systems  in  both  manual 
and  autopilot  modes  resulted  in  less  than  1.0  nm  total 
system  error  (two  sigma,  95%  probability)  in  terminal 
area  and  enroute  operations. 

• The  accuracy  demonstrated  with  a minimum  capability  general 
aviation  RNAV  system  was  less  than  1.5  nm  total  system 
error  (two  sigma,  95%  probability)  in  terminal  area  and 
enroute  operations. 

• Qualitative  analysis  of  the  operational  data  has  shown 
that  compatible  terminal  area  accuracy  and  functional 
performance  was  demonstrated  by  all  three  levels  of  RNAV 
equipment. 
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Error  Combination  and  Correlation 


The  RSS  error  combination  technique  was  found  to  be  overly  conservative. 
Evidence  of  error  correlation  between  FTE  and  other  error  sources  was  obtained 
for  several  levels  of  RNAV  equipment.  (Figures  4.14  and  4.15). 

• The  RSS  computation  based  on  measured  component  errors 
resulted  in  a computed  Total  System  Cross  Track  error 
which  was  35%  larger  than  the  measured  total  system 
cross  track.  When  the  RSS  computation  showed  2.0  nm, 
the  measured  Total  System  Cross  Track  was  1.3  nm. 

• The  reasons  for  the  demonstrated  conservatism  were: 

(1)  FTE  correlates  with  other  error  quantitites  which 
invalidates  the  RSS  technique;  (2)  measured  FTE  was 
almost  the  same  magnitude  as  Total  System  Cross  Track 
error  regardless  of  RNAV  system  sophistication,  absolute 
Total  System  Cross  Track  accuracy,  or  the  navigation 
mode  (manual  or  autopilot).  This  relationship  precludes 
the  use  of  the  RSS  computation  technique  if  an  accurate 
calculation  of  Total  System  Cross  Track  error  is  desired. 

• Modification  of  RSS  computation  of  total  system  error  based 
on  measured  component  errors  to  include  empirically  de- 
termined error  correlation  coefficients  was  shown  to  be  a 
plausible  and  more  accurate  technique  for  predicting  Total 
System  Cross  Track  error  for  both  airline  and  general  avia- 
tion RNAV  equipment. 

Workload  and  Blunder  Considerations 

Workload  and  blunder  analysis  established  the  need  for  well  defined 
RNAV  procedures  when  sequencinq  waypoints  and  when  intercept! n^_a_  VNM 
gl ideslope~  TTable  3.41  and  Figure  4TT67^ 

• Repetitive  turn  overshoots  demonstrated  the  requirement 
for  orienting  pilots  to  RNAV  turn  procedures  and  estab- 
lishing training  requirements  to  achieve  the  compatible 
turn  performance  desired. 

• The  extra  input  workload  associated  with  VNAV  descents 
caused  frequent  input  data  errors  and  consistent  over- 
shooting of  the  desired  VNAV  descent  path.  Although 
VNAV  is  not  required  as  a minimum,  errors  in  actual 
descent  path  resulting  from  these  procedural  mistakes 
generally  caused  the  aircraft  to  descend  above  the 
desired  glideslope  since  the  descent  was  initiated 
late  and  the  desired  slope  was  not  usually  achieved. 

• RNAV  (p,o)  manual  update  generally  required  about  19 
seconds  to  complete  for  the  general  aviation  analog  RNAV 
system.  Since  an  aircraft  travels  about  1.0  nm  along 
course  during  this  time  at  terminal  area  speeds,  it  is 
not  advisable  to  update  RNAV  inputs  when  the  current  air- 
craft heading  is  intersecting  the  desired  course.  That 
is,  it  is  not  good  procedure  to  manually  update  navigation 
data  while  attempting  to  intercept  a course  for  a STAR, 
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while  transitioning  to  or  from  a parallel  offset,  or  while 
performing  a simple  course  change  since  updating  at  these 
times  increases  the  possibility  of  overshooting  the  de- 
sired track  and  possibly  the  protected  airspace  limits. 

• The  most  significant  blunder  occurred  due  to  pilot  dis- 
orientation on  base  leg  which  resulted  in  the  early  in- 
put of  the  missed  approach  waypoint.  The  resulting  air- 
space excursion  was  not  acceptable. 

• The  increased  input  and  display  scanning  workload  associated 
with  a VNAV  approach  resulted  in  a corresponding  reduction 
in  time  spent  monitoring  the  CDI  for  lateral  navigation 
accuracy.  For  example,  one  particular  data  set  showed  the 
measured  lateral  FTE  during  a series  of  VNAV  approaches 

was  0.54  nm  compared  to  0.40  nm  during  a similar  series 
of  procedural  descents  on  a 2D  RNAV  approach. 
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UNIVERSITY  OF  ILLINOIS  COCKPIT  SIMULATOR  EXPERIMENT 
A. 1.0  INTRODUCTION 

The  primary  goal  of  the  ATC  system  is  the  safe  movement  of  aircraft  from 
one  place  to  another.  As  the  level  of  traffic  increased  and  the  need  to  con- 
serve fuel  became  more  acute,  the  efficiency  of  air  traffic  movements  in  the 
National  Airspace  System  (NAS)  became  an  important  goal  as  well.  Area  navi- 
gation, which  will  achieve  both  goals,  is  being  offered  as  an  alternative  to 
the  present  navigation  system. 

The  safety  of  aircraft  operations  under  the  rules  of  instrument  flight 
is  assured  by  the  assignment  of  airspace  buffers  to  each  aircraft  in  the 
systan.  The  efficiency  of  aircraft  traffic  movements  under  these  regulations 
is  enhanced  by  the  limitation  of  each  of  these  airspace  buffers  to  the  magni- 
tude necessary  for  the  achievement  of  safety  in  the  systaii.  The  magnitude  of 
these  airspace  buffers,  which  is  proportional  to  navigation  error,  deteniiines 
allowable  course  proximity  and  vertical  separation  of  aircraft  and  thus,  it 
influences  the  saturation  volume  of  the  system. 

Recently  efforts  have  been  made  to  quantify  buffer  requirements  of  air- 
craft using  area  navigation  (RNAV)  equipment  and  to  detennine  the  implications 
to  users  of  the  National  Airspace  System.  The  initial  documents  dealing  with 
this  topic  were  Radio  Technical  Commission  for  Aeronautics  (RTCA)  Document 
DO-140  (1969)  and  FAA  Advisory  Circular  AC  90-45  (1969),  which  established  em- 
pirically quantitative  bases  for  assigning  airspace  buffers  with  horizontal 
area  navigation.  Vertical  Area  Navigation  System  Analysis  (FAA-RD-72-1  25 , 

Bolz,  E.  H.  and  McConkey,  E.  D.,  1972)  provided  background  material  for  RTCA 
Document  DO-152  (1972)  and  FAA  Advisory  Circular  AC  90-45A  (1975)  which  ex- 
tended these  guidelines  to  include  vertical  area  navigation  (VNAV).  Three  and 
Four  Dimensional  Area  Navigation  Study  (FAA-RD-74-1 50  Hemesath,  N.  B.,  Bruckner, 
J.  M.  H.,  Krippner,  R.  A.,  Meyer,  D.  H.,  and  Murphy,  J.  W.,  1974)  and  the  1972 
FAA/Industry  Task  Force  Report,  Application  of  Area  Navigation  in  the  National 
Airspace  System,  studied  the  implementation  of  navigation  with  vertical 
guidance.  Effects  of  Navigation  Procedural  Complexity  (FAA-RD-74-148,  Jensen, 

R.  S.,  and  Roscoe,  S.  N.,  1974)  provided  evidence  for  the  need  to  simplify 
area  navigation  procedures  in  the  terminal  area. 

In  the  terminal  area,  a major  advantage  of  area  navigation  is  the  freedom 
to  assign  aircraft  to  offset  routes  which  parallel  the  standard  routing  in 
order  to  sequence  more  efficiently,  aircraft  operating  through  a wide  range  of 
speeds.  A slower  aircraft  could  be  assigned  to  an  offset  route  to  allow  a 
faster  one  to  pass  him,  rather  than  having  to  hold.  The  procedure,  of  course, 
introduces  additional  complexity  to  the  pilot’s  task  resulting  in  an  increase 
in  his  steering  error  and  blunder  rate  (FAA-RD-74-148,  Jensen  and  Roscoe,  1974). 
The  magnitude  and  frequency  of  these  error";  must  be  evaluated  systematically 
under  a variety  of  conditions  to  detennine  their  impact  on  the  system. 

Just  as  the  complexity  of  the  environment  affects  the  probability  of  pilot 
error,  the  capabilities  of  his  on-board  operating  system  affect  his  ability  to 
cope  with  task  complexities.  The  larger  the  load  which  he  could  transfer  to 
his  operating  system,  theoretically  the  greater  the  canplexity  he  could  manage 
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without  increased  error.  One  way  of  transferring  a part  of  the  workload  to  the 
operating  system  is  through  the  use  of  waypoint  data  storage.  Compared  with  a 
one-waypoint  systaii,  a multi-waypoint  system  reduces  the  number  of  required 
data  entries  in  flight  and  permits  the  pilot  to  enter  data  between  turns  where 
the  aircraft  control  workload  is  minimal.  One  would  expect  such  a systan  to 
reduce  tracking  error  in  turns  and  to  reduce  navigation  data  entry  blunders. 

Some  data  is  available  (Roscoe  and  Kraus,  1973)  which  indicates  that  a two-way- 
point  systan  may  lead  to  confusion  concerning  which  waypoint  is  being  used  re- 
sulting in  higher  blunder  rates.  However,  additional  data  is  needed  to  show 
the  effects  on  pilot  performance  of  systematically  varying  waypoint  storage 
capaci ty . 

One  additional  problem  primarily  arising  as  a result  of  parallel  course 
offsets  involves  turn  anticipation  to  avoid  large  overshoot  or  undershoot  of 
the  outbound  course.  It  is  an  established  standard  operating  procedure  (FAA 
Airman's  Information  Manual  - Part  1)  that  turn  anticipation  is  to  be  used  to 
prevent  course  overshoot.  When  operating  on  the  course  centerline,  turn  antic- 
ipation is  a fairly  simple  procedure  involving  turn  radius  and  turn  magnitude. 

However,  turn  anticipation  while  operating  on  parallel  course  offsets  is  a 
more  complex  procedure. 

For  example,  there  are  four  possible  ways  that  along  course  distance 
could  be  presented  to  the  pilot.  These  are:  (1)  distance  to  the  turn  point, 

(2)  distance  to  the  bisector  of  the  turn  angle,  (3)  distance  to  the  wayline 
(a  line  through  the  waypoint  perpendicular  to  the  selected  course),  and  (4) 
distance  to  the  waypoint.  The  first  of  these  provides  all  the  information 
that  is  required  in  conventional  centerline  tracking  and  turn  anticipation 
I should  be  fairly  easy.  The  second  provides  all  necessary  infornation  if  the 

f outbound  offset  is  the  same  as  the  inbound  offset  but  requires  an  additional 

algorithm  for  turn  anticipation  if  the  outbound  offset  is  different.  The 
third  and  fourth  methods  both  require  relatively  complex  algorithms  for  accu- 
rate turn  anticipation.  In  this  study  the  pilot  was  presented  with  distance 
to  the  wayl ine. 

Given  a presentation  of  distance  to  the  wayline,  one  can  see  a number  of 
alternatives  required  of  the  turn  anticipation  algorithm.  On  an  inside  offset 
(i.e.,  parallel  course  offset  is  inside  the  turn  for  both  inbound  and  outbound 
courses),  the  pilot  must  initiate  the  turn  well  before  his  distance  indicator 

reads  zero.  On  an  outside  offset,  the  pilot  must  fly  past  zero  distance  to  | 

some  point  beyond  the  wayline  before  initiating  his  turn.  Between  these  ex- 
tremes are  many  other  alternatives  needing  solution  in  the  turn  anticipation 
algorithm. 

j There  are  two  possible  approaches  to  the  implementation  of  the  algorithm 

' which  is  developed.  The  first  provides  the  pilot  with  a set  of  procedures  to 

follow  depending  on  offset,  turn  direction  and  magnitude,  and  ground  speed. 

In  this  case  the  pilot  receives  no  additional  displayed  information  concerning 
when  to  initiate  his  turn.  This  approach  is  called  procedural  turn  anticipation. 

The  second  approach  provides  the  pilot  with  a visual  indication  when  he  reaches 
the  point  at  which  the  turn  should  be  initiated.  In  this  case  all  of  the  cal- 
culations are  made  in  the  system  and  presented  to  the  pilot  automatical ly  at 
the  appropriate  time.  This  second  approach  is  called  auto  turn  anticipation. 

The  purpose  of  this  study  is  to  investigate  the  effects  of  three  levels 
of  waypoint  storage  capacity,  two  methods  of  turn  anticipation,  and  five  levels 
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of  parallel  course  offset  on  pilot  steering  performance  and  procedural  accuracy 
in  terminal,  two  and  three-dimensional,  area  navigation  operations.  Although 
this  is  a simulator  study,  the  investigation  requires  a close  simulation  of  the 
real-world  flight  environment  involving  active  pilots  of  all  experience  levels. 
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A. 2.0 


METHOD 


A. 2.1  EXPERIMENTAL  FACILITIES 

The  area  navigation  simulation  system  used  for  this  study  is  a modifica- 
tion of  an  existing  system  which  was  initially  developed  at  the  Aviation  Research 
Laboratory  in  1970.  At  that  time  the  system  consisted  of  a Singer-Link  GAT-2 
twin-engine  general  aviation  trainer,  a Raytheon  704  digital  computer,  a Narco 
RNAV  display,  and  an  experimental  RNAV  control  panel.  This  system  was  first 
used  in  combined  aircraft  and  simulator  area  navigation  studies  of  pilotage 
error  using  symbolic  displays.  Following  this,  the  system  was  modified  and 
expanded  to  include  vertical  guidance  and  was  used  in  a study  of  the  effects 
of  descent  angle  and  display  scale  factor  on  pilotage  error.  The  system  used 
for  this  study  demanded  certain  modifications  and  additions  to  include  capabil- 
ities for  parallel  offset  courses,  turn  anticipation,  and  variable  waypoint 
storage.  However,  the  major  components  of  the  system  remained  basically  the  same. 

A. 2. 2 HARDWARE  SYSTEM 

A functional  block  diagram  of  the  hardware  of  the  area  navigation  simu- 
lation system  used  for  this  study  is  shown  in  Figure  A.l.  The  two  major  con - 
ponents  of  the  system,  the  Raytheon  704  and  the  GAT-2,  are  shown  in  Figure  A. 2. 

The  Raytheon  704  digital  computer  with  its  extensive  input-output  capabilities 
performs  the  duties  of  real-time  navigation  computation,  interfacing  of  cockpit 
navigation  control  and  display,  waypoint  storage,  and  pilot  performance  data 
collection  (on  magnetic  tape).  The  GAT-2  and  its  simulation  computer  provides 
the  functions  of  flight  simulation  (including  motion,),  three  dimensional  track- 
ing, and  airspeed  monitoring.  The  cockpit^  of  the  GAT-2  was  modified  for  this 
study  to  include  a Control  Display  Unit  (CDU),  left  and  right  offset  indicator 
lights,  a turn  anticipation  indicator  light,  a digital  distance-to-waypoint 
indicator,  and  an  integrated  course  deviation  and  vertical  guidance  instrui'ient 
as  shown  in  Fiugre  A. 3. 

Figure  A. 4 shows  a detailed  diagram  of  the  CDU  which  is  interfaced  to  the 
Raytheon  704  and  is  used  for  entry  and  display  of  navigation  data  during  a 
flight.  After  the  appropriate  lighted  data-type  button  is  pushed  on  the  panel, 
the  data  is  entered  on  the  keyboard  and  displayed  on  the  appropriate  numeric 
display.  The  ENTER  button  is  then  pushed  and  the  data  is  sent  to  the  Raytheon 
704  which  decodes  it,  stores  it,  and  reconfirms  it  to  the  pilot  on  the  same 
display.  A complete  set  of  data  for  a waypoint  definition  iticludes:  frequency 
(FREQ)  of  the  VOR,  the  radial  (RAD)  and  distance  (DIST)  of  the  waypoint  from 
the  VOR,  the  course  (CRS  IN  DEG)  to  be  flown  to  the  waypoint,  the  altitude 
(ALT)  and  slope  (SLOPE)  at  the  waypoint  (if  required),  and  the  parallel  course 
offset  (0FST)(if  required).  The  turn  anticipation  button  (ANT)  is  used  only  for 
flight  with  one  waypoint  storage  capability.  The  numeric  keyboa-d  on  the  CDU 
contains  two  dual  mode  keys  for  parallel  offset  course  entry.  The  mode  of  these 
keys  is  controlled  automatically  by  the  CDU  when  OFST  is  pushed  to  first  accept 
the  left  (L)  or  right  (R)  indication  and  then  the  distance  in  nautical  miles. 

The  two  indicator  lights  labeled  L and  R are  provided  on  the  panel  for  confir- 
mation of  offset  direction  as  it  is  entered.  A manual  confirm  (CONFIRM)  mode 
is  also  available  on  the  CDU  to  allow  the  pilot  to  confirm  any  previously  entered 
navigation  data. 
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ricjure  A. 2 The  GAl-2  and  Raytheon  704  at  the  Aviation  Research  Laboratory 


Figure  A.l  A Functional  Block  Diagram  of  the  GAT-2/Ratheon  704  Area 
Navigation  Simulation  System 
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Figure  A. 3 The  GAT-2  Left  Seat  Instrument  Panel  Showing  the  Area 
Navigation  Controls  and  Displays 
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Figure  A. 4 Control  Display  Unit  (CDU)  for  Lntry  of  Navigation  Data 


Figure  A. 5 shows  a diagram  of  the  cockpit  instrument  panel  displays  used 
for  this  study.  The  digital  distance-to-waypoint  display  indicates  the  dis- 
tance along  course  in  tenths  of  a nautical  mile  ^rom  the  waypoint.  The  course 
deviation  needle  is  scaled  to  indicate  a maximum  deviation  of  i2.b  nautical 
miles  left  or  right  of  the  selected  course  line.  Also  integrated  into  this 
instrument  is  a vertical  guidance  needle  with  a total  deflection  of  + 250  feet 
from  the  desired  vertical  path  set  on  the  CDU.  Indicator  lights  labeled  L 
and  R are  provided  to  confirm  to  the  pilot  the  direction  of  the  offset  entered 
for  the  current  waypoint  in  use.  Finally,  a turn  anticipation  indicator  light 
labeled  "A"  lights  up  to  indicate  that  the  proper  distance  from  a waypoint  has 
been  reached  for  the  start  of  a turn  from  the  cu>^rent  course  to  the  next  course. 


The  final  item  included  in  the  area  navigation  simulation  system  is  an  air 
traffic  controller  station  with  an  audio  link  between  the  controller  and  the 
GAT-2  radio  to  provide  the  pilot  with  the  required  simulated  ATC  clearances  dur- 
ing a flight.  The  station  also  includes  an  X-Y  plotter  which  follows  the  pro- 
gress of  the  flight  in  two  dimensions  on  a predrawn  chart  of  the  route.  An 
eight  channel  strip-chart  recorder  was  additionally  incorporated  at  the  station 
to  provide  further  flight  data  monitoring  by  the  controller  and  to  furnish  back- 
up pilot  performance  data  collection. 


Figure  A. 5 


Distance-to-Waypoint , Course  Deviation  and  Vertical  Guidance 
Displays,  and  Offset  and  Turn  Anticipation  Lights 
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A. 2. 3 SOFTWARE  SYSTEM 


Figure  A. 6 shows  a flow  diagram  of  the  real-time  software  system  in  the 
Raytheon  704  for  the  area  navigation  simulation  required  in  this  study.  First 
of  all,  preliminary  infoniiation  for  the  particular  flight  to  be  run  is  entered 
on  the  teletype.  This  information  includes  flight  identification,  waypoint 
storage  capability,  offset  type,  and  turn  anticipation  type.  Following  this, 
the  main  program  loop  is  entered  which  first  obtains  the  X and  Y position,  the 
altitude,  and  the  airspeed  of  the  GAT-2  from  the  simulation  computer  of  the 
GAT-2.  Next  the  program  examines  the  CDU  for  any  navigation  data  entered  by 
the  pilot.  If  data  is  present,  it  is  retrieved,  decoded,  processed,  and  put 
into  a waypoint  storage  file  in  the  computer.  The  data  entered  is  then  sent 
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Figure  A, 6 Real-Time  Software  System  for  Area  Navigation  Simulation  on  the 
Raytheon  704 


back  to  the  CDU  for  confirmation  by  the  pilot.  Trigonometric  navigation  and 
vertical  guidance  calculations  based  on  the  waypoint  in  use  and  the  current 
GAT-2  data  are  then  performed.  Also  the  calculation  for  turn  anticipation  dis- 
tance is  made  at  this  time  if  applicable.  Finally,  program  control  is  trans- 
ferred to  the  output  routine  which  sends  the  appropriate  signals  to  the  GAT-2 
instrument  panel  displays.  The  main  program  loop  is  now  complete  and  is  re- 
cycled to  the  beginning  for  the  next  time  through.  This  loop  cycles  at  a 
sufficient  speed  to  maintain  smooth  operations  of  all  displays  and  controls  in 
the  system. 

In  the  background  of  the  main  program  is  a software  clock  which  interrupts 
the  main  program  once  during  every  second  of  the  flight.  This  interrupt  rou- 
tine, shown  in  Figure  A. 7,  provides  a constant  time  interval  for  data  collection 
and  ground  speed  calculation.  To  insure  smooth  operation  of  the  simulation, 
pilot  performance  data  is  first  collected  in  a 1024  word  buffer  and  is  trans- 
ferred to  magnetic  tape  only  when  the  buffer  is  full.  The  ground  speed 
calculation  which  is  used  for  the  determination  of  turn  anticipation  distance 
is  performed  by  continuous  digital  differentiation  of  the  distance-to-waypoint 
over  a twenty  second  interval. 


Figure  A. 7 Software  Clock  Interrupt  Routine 
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A. 2. 4 NAVIGATION  ALGORITHMS 


Figure  A. 8 shows  the  two-dimensional  navigation  geometric  relationships 
used  for  calculations.  The  waypoint  location  is  defined  by  the  range  and  bear 
ing  from  the  VOR  location  which  is  prestored  in  the  computer.  The  deviation 
from  course,  Xp,  is  the  distance  used  for  the  needle  deflection  of  the  GDI. 

The  digital  distance-to-waypoint  indicator  in  the  cockpit  uses  the  distance, 
Yq,  which  is  the  distance  along  course  and  not  the  hypotenuse  distance  which 
would  be  shown  on  a normal  DME.  When  an  offset  is  entered  by  the  pilot,  the 
waypoint  location  used  for  the  calculation  of  Xd  is  shifted  perpendicular  to 
the  course  at  the  distance  and  direction  selected.  Therefore,  the  GDI  needle 
then  indicates  the  deviation  from  the  parallel  offset  course.  This  was  done 
for  simplicity  of  calculation  only,  and  if  the  pilot  were  to  manually  confirm 
the  waypoint  on  the  CDU,  he  would  see  the  location  just  as  he  entered  it. 


TRUE 


Figure  A. 8 Area  Navigation  Simulation  Geometric  Relationships  with 
Right  Offset  Example 
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Figure  A. 9 shows  an  example  of  the  relationships  used  for  calculation  of 
turn  anticipation  with  two  different  offset  distances.  The  total  anticipation 
distance  along  course  is  a combination  of  dj  and  d/\  plus  one-fourth  of  a nauti- 
cal mile  (to  allow  for  pilot  preparation  time  for  the  turn).  The  distance,  dj, 
is  a function  of  the  angular  difference,  0c,  between  the  two  course  angles,  6i , 
and  02,  and  the  radius,  r,  of  the  standard  rate  turn  (3  degrees/second).  The 
radius'is  a function  of  the  ground  speed  of  the  aircraft  while  making  the  turn. 
There  is  an  additional  distance,  d^,  required  for  the  calculation  when  offsets 
are  used  which  is  a function  of  the  two  offset  distances,  d]  and  d2,  and  O^.. 

The  anticipation  distance  calculated  is  compared  by  the  software  to  the  distance- 
to-waypoint  (Yq  from  Figure  A. 8),  and  when  they  are  equal  the  anticipation  light 
on  the  cockpit  instrument  panel  is  lit  and  stays  lit  for  one  nautical  mile  past 
this  point. 


Y 


Figure  A. 9 Turn  Anticipation  Geometric  Relationships  with  Offsets 


A-n 


The  turn  anticipation  calculation  is  only  possible  for  mu  1 ti -waypoint 
systems,  and,  therefore,  when  the  one-waypoint  system  is  used  the  pilot  selects 
his  best  estimate  of  the  anticipation  distance  on  the  CDU.  To  aid  the  pilot  in 
making  this  estimate  he  was  provided  with  the  information  shown  in  Figure  A. 10. 
This  is  a talbe  of  example  turn  anticipation  distances  for  various  turn  angles, 
offsets  and  airspeeds.  Offsets  are  assumed  to  be  the  same  before  the  turn  and 
after  the  turn.  The  distances  are  in  nautical  miles  TO  (positive  numbers)  or 
FROM  (negative  numbers)  the  waypoint  and  do  not  include  the  0.25  nautical  mile 
preparation  distance  which  was  automatically  added  to  the  entered  estimate  by 
the  computer. 

Vertical  guidance  calculations  were  performed  on  the  basis  of  the  slope  to 
the  waypoint  and  the  altitude  at  the  waypoint  entered  on  the  CDU  by  the  pilot. 
Figure  A. 11  shows  an  example  of  this  in  which  the  pilot  has  commanded  a descent 
to  an  altitude  at  the  waypoint.  He  will  receive  a full  fly-up  needle  indication 
until  reaching  the  glide  path  calculated  by  the  computer.  At  this  time,  he 
may  intercept  the  path  and  descend  to  the  altitude  keeping  the  needle  centered 
as  in  a conventional  glideslope  approach  to  a runway. 

Subjects  for  this  investigation  were  chosen  from  pilots  actively  engaged 
in  flight  operations  demanding  current  instrument  proficiency.  The  thirty 
pilots  who  participated  ranged  in  flight  experience  from  15,900  to  275  total 
hours.  Average  total  accumulated  flight  hours  for  the  group  was  5,237  hours. 
Pilots  were  chosen  from  four  groups:  test  pilots  employed  at  the  FAA  National 
Aviation  Facilities  Experimental  Center  (NAFEC);  pilots  employed  in  air  carrier 
operations  as  captains  or  first  officers  (ALP);  local  pilots  holding  the  multi- 
engine  Airline  Transport  certificate  (ATP);  and  local  pilots  holding  the 
commercial  certificate  with  instrument  and  multi-engine  ratings  (CIP).  A break- 
down of  flight  experience  by  categories  for  each  pilot  is  given  in  Table  A. 1 . 

This  study  is  one  in  an  overall  experimental  plan  being  conducted  at  a 
number  of  locations  to  determine  flight  technical  error  as  a function  of  various 
RNAV  airborne  system  characteristics.  Therefore,  the  experimental  plan  and 
procedures  for  this  study  were  developed  to  fit  this  overall  plan  and  permit  a 
cross  correlation  of  data  among  the  various  experiments.  The  goal  of  this 
strategy  is  to  provide  general  answers  applicable  to  a broad  spectrum  of 
problem  areas. 

The  flight  task  developed  for  this  study  is  an  adaptation  of  a flight 
task  used  in  a number  of  experiments  at  FAA  NAFEC.  It  is  based  on  Standard 
Instrument  Departures  (SIDs)  and  Standard  Terminal  Arrival  Routes  (STARs)  from 
a New  York  RNAV  terminal  area  designed  by  Systems  Control,  Inc.  (Vt)  and 
adapted  to  the  Atlantic  City  area. 

The  tasks  consist  of  a SID,  a STAR,  and  an  approach  to  the  Atlantic  City 
NAFEC  airport.  The  SID,  Atlantic  City  Two  RNAV  Departure  (Figure  A. 12),  in- 
volv  five  segments  defined  by  five  waypoints.  As  indicated  in  Figure  A. 12, 
the  p.lot  is  directed  to  climb  directly  to  12,000  feet.  This  climb  was  usually 
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Table  A.l  Flight  Experience  of  Pilot  Subjects  in  Hours 


Instru- 

ment 

IL6M  * 

Multl- 

Eneine 

Light 

Twin 

Sini 

lat< 

NAFEC 

1 

j 11,000 

1,100 

50 

9,000 

100 

! 20 

NAFEC 

1 15,900 

700 

20 

11,500 

500 

i 10 

NAFEC 

1 3,000 

200 

15 

700 

700 

2 

NAFEC 

400 

70 

20 

175 

175 

NAFEC  i 

i 10,000 

1,800 

20 

6,500 

1,000 

30- 

NAFEC 

10,500 

700 

10 

3,500 

500 

7 

AI.P 

14,000 

3,000 

60 

13,000 

150 

1' 

ALP 

12,000 

1,100 

60 

9,500 

400 

5- 

ALP 

5,000 

1,000 

99 

2,000  j 

0 

30- 

ALP 

8,900 

850 

24 

7,700 

210 

9i 

Al.P 

8,000 

800 

30 

5,500 

200 

15i 

ALP 

4,300 

140 

3 

320 

20 

10- 

ATP 

4.010 

350 

35 

1,100 

1 ,050 

3 

ATP 

6,212 

810 

40 

1,929 

1,929 

ATP  I 

13,477 

2,598 

18 

9,192 

200 

28 

ATP 

7,500 

470 

23 

2,500 

1,900 

b 

ATP 

o 

o 

350 

25 

615 

615 

2 

ATP  I 

3,000 

150 

6 

300 

300 

31 

CIP 

1,200 

200 

50 

11 

11 

7i 

CIP 

2,500 

76 

12 

50 

50 

2i 

CIP 

3,200 

150 

15 

350 

100 

7- 

CIP 

450 

70 

15 

10 

10 

5 

CIP 

430 

55 

2 

24 

24 

2i 

CIP 

1,470 

85 

3 

55 

55 

7: 

CIP 

275 

41 

3 

11 

11 

3 

CIP 

1,850 

150 

6 

54 

54 

6 

CIP 

970 

80 

6 

18 

18 

51 

CIP 

1,655 

108 

9 

37 

37 

3: 

CIP 

370 

54 

38 

9 

9 

4 

CIP  ^ 

1,450 

300 

30 

1,200 

100 

201 

lOJc'  IL6M  - instrument  experience  in  the  last  six  (6)  month 


completed  by  eight  to  ten  miles  before  Charlie  waypoint.  Therefore  a level 
altitude  of  12,000  feet  was  maintained  from  Charlie  to  Mike  waypoints.  He  was 
to  maintain  course  centerline  until  two  miles  after  the  Charlie  waypoint.  At 
this  point,  one  of  four  parallel  course  offsets  could  be  assigned  to  him: 
three  or  five  miles  left  or  right  of  centerline.  A fifth  alternative,  center- 
line  tracking,  was  also  possible.  These  offsets  were  to  be  maintained  until 
beyond  the  Mike  waypoint.  The  STAR,  NAFEC  Two  RNAV  Arrival  (Figure  A. 13)  con- 
sists of  three  segments  defined  by  four  waypoints.  The  pilot  begins  the  STAR 
procedures  on  the  offset  assigned  to  him  previously  in  the  SID.  He  receives  a 
clearance  to  return  to  course  centerline  at  seventeen  miles  before  Foxtrot. 

He  receives  a clearance  to  descend  to  6,000  feet  at  thirteen  miles  before 
Foxtrot.  Usually,  6,000  feet  was  reached  near  Foxtrot  waypoint.  Pilots  re- 
ceived offset  clearances  of  three  and  five  miles  on  either  side  of  base  leg 
(Golf  to  Hotel)  to  simulate  sequencing  of  traffic.  On  this  segment,  a guided 
three  degree  descent  reduced  the  altitude  to  1,930  feet  at  Hotel. 


NAreC  TWO  RNAV  ARWIVAt 
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106  « ACV 
» 5V47  7 


'V'*,  dlr«et  Toitrot 
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6000’,  crooo  Coif  W/P  of  6000’ 
Dotctnd  on  S*  GHdotlo^ 
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Crot*  Hefol  e»  1930  foot. 
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Figure  A. 13  Procedure  for  RNAV  Arrival 


The  approach,  NAFEC  RNAV  Runway  4 approach  (Figure  A. 14)  consists  of  the 
final  approach  segment  between  the  base  leg  intercept  of  final  approach  and 
Juliet  waypoint.  After  his  directed  descent  to  1,930  feet  on  base,  the  pilot 
flies  level  until  intercepting  his  glideslope  at  s'x  miles  from  Juliet.  He 
then  descends  on  the  glideslope  to  a minimum  descc.it  altitude  (MDA)  of  520 
feet  MSL  where  he  is  told  the  runway  is  in  sight  and  continues  on  the  glide- 
slope  to  touchdown. 

, Figure  A. 15  presents  the  horizontal  view  of  the  complete  course.  The 
dotted  lines  indicate  three  and  five  mile  offsets  left  and  right  of  course 
for  the  segments  on  which  they  were  used.  Total  distance  around  the  course 
on  the  centerline  is  169.3  nautical  miles  and  requires  an  average  of  one 
hour  flight  time.  Both  time  required  and  distance  flown  are  increased  on 
the  right  offsets  and  decreased  on  left  offsets. 


Figure  A. 15  Horizontal  View  of 
the  Flight  Task 


Figure  A. 14  NAFEC  RNAV  Approach 
to  Runway  4 
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A. 2. 8 EXPERIMFNTAL  DESIGN 

The  experiment  employed  a mixed-model  design  (Figure  A. 16)  with  two  be- 
tween-subject  factors,  turn  anticipation  and  waypoint  storage,  and  one  within- 
subject  factor,  flights.  On  each  flight,  a different  course  offset  was 
required  permitting  this  variable  to  be  substituted  in  flights  as  the  within- 
subject  factor.  Within  each  block  of  five  subjects  shown  in  Figure  A. 16  a 
5x5  latin  square  design  was  used  to  counterbalance  offsets  over  flights  to 
reduce  learning  effects  on  the  offset  variable.  The  counterbalancing  tech- 
nique used  is  shown  in  Table  A. 2. 

Pilot  subjects  were  systematically  counterbalanced  by  group  in  all  blocks 
of  the  design.  For  example,  each  block  consisted  of  one  NAFEC  pilot,  one  ALP, 
one  ATP  and  two  ClPs.  An  attempt  was  also  made  to  counterbalance  the  groups 
over  the  order  in  which  offsets  were  seen,  although  this  counterbalancing  could 
not  be  fully  accomplished  because  there  were  four  groups  and  five  orders.  The 
degree  of  success  in  counterbalancing  flight  experience  by  variables  of  inter- 
est is  shown  in  Table  A. 3. 


SUBJECTS  1 SUBJECTS 


FIVE 

SUBJECTS  1 SUBJECTS 


FIVE 

SUBJECTS  I SUBJECTS 


PROCEDURAL  Auto 

TURN  ANTICIPATION 


Figure  A. 16  Experimental  Design 

(A  different  course  offset  was  used  on  each  flight) 


A. 2. 9 EXPERIMENTAL  PROCEDURE 

Although  many  of  the  pilots  had  previous  experience  using  RNAV  in  one 
form  or  another,  a thorough  instruction  and  familiarization  program  was  given 
to  each.  A packet  of  general  RNAV  information  and  specific  instructions 
concerning  the  use  of  the  RNAV  system  and  simulator  was  provided  for  each  sub- 
ject to  study  well  in  advance  of  his  participation  in  the  experiment.  When 
subjects  arrived  at  the  laboratory,  they  were  given  an  oral  review  of  the 
instruction  packet  and  a briefing  specific  to  the  RNAV  system  for  which  they 
were  to  fly.  Fol lowing  the  briefings , the  subject  was  given  a cockpit  checkout 
including  a familiarization  with  all  aspects  of  the  flight  operation  and  an 
oral  run-through  of  the  familiarization  flight  course.  Then  the  subject  made 
a familiarization  flight  on  a course  different  from  the  experimental  course  but 
which  included  all  operations  which  could  be  expected  on  the  experimental 
flights.  Following  a debriefing,  the  subject  made  five  flights  over  the 
experimental  task. 

During  the  experimental  flights,  every  effort  was  made  to  optimize  the 
apparent  reality  of  the  situation.  The  pilot  was  required  to  handle  all  as- 
pects of  the  flight  task  as  he  would  in  a one-pilot  operation  including  air- 
craft control,  flight  planning,  navigation  data  input,  and  communications. 

On  the  experimental  flights,  subjects  were  given  the  charts  shown  in  Figures 
A.  12  - A.  14  to  use  for  navigation.  All  clearances  were  handled  through  radio 
communications  with  a simulated  ATC  controller  on  the  outside.  While  enroute, 
clearances  were  read  to  other  aircraft  to  increase  the  illusion  of  flying  in 
the  terminal  air  traffic  environment.  Experimental  variables  such  as  course 
offset  and  airspeed  restrictions  were  relayed  to  the  pilot  through  the  ATC 
controller. 

A tacit  experimental  observer  was  present  in  the  cockpit  to  record  pTiot 
blunders  and  to  provide  help  in  the  event  that  the  subject  became  irrevocably 
confused  or  disoriented.  Interventions  into  the  flight  operation  by  the 
observer  were  kept  to  a minimum.  The  observer  did  not  intervene  unless  the 
•ubject  became  so  confused  that  more  than  one  segment  of  data  would  be  lost 
as  a result  of  the  error.  He  normally  maintained  the  posture  of  a quiet,  non- 
flying passenger  who  happened  to  be  occupying  the  co-pilot  or  jump  seat.  The 
observer  recorded  all  uncorrected  navigation  procedural  errors  on  the  observer 
log  sheet  shown  in  Figure  A. 17.  Procedural  errors  were  also  recorded  for  hori- 
zontal excursions  from  course  of  more  than  two  miles  (four  dots),  vertical 
excursions  of  more  than  200  feet  (four  dots),  and  anytime  help  was  required  of 
the  observer. 

A. 2. 10  PERFORMANCE  ASSESSMENT 

During  the  experimental  flights,  digital  recordings  of  altitude,  X and  Y 
position  of  the  simulator,  left-right  needle  deflection,  X and  Y position  of 
the  waypoint  set,  course  set,  airspeed,  vertical  needle  deflection,  altitude 
set,  and  glideslope  set  were  made  at  one  second  intervals  on  a magnetic  tape. 
Altitude,  X position,  Y position  and  airspeed  were  then  used  to  calculate 
horizontal  and  vertical  error  from  the  desired  flight  path  and  error  from  de- 
sired airspeed.  This  data  was  then  reduced  to  one  point  for  each  one-half 
mile  around  the  course  by  choosing  the  first  data  point  following  passage  of 
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Figure  A. 17  Observer  Checklist  for  RNAV  Anticipation  Study 


each  one-half  mile  of  the  course.  This  data  set,  consisting  of  one  point  for 
each  half-mile,  was  then  used  for  the  analyses  for  the  results. 


A. 2. 11  STATISTICAL  TREATMENT 

Transient  and  steady-state  data  were  located  by  the  use  of  summary  plots 
of  central  tendency  (M)  and  standard  deviation  (a)  of  horizontal  tracking  error 
calrulated  at  each  half  mile  around  the  course  across  all  flights  on  each  off- 
set The  formula  used  for  standard  deviation  was: 

, 5:  (Xi  - m)2  (1) 


N - 1 


where: 

Xj  = error  measured  at  one  of  the  sampling  points, 

N = the  number  of  measurements  at  that  sampling  point,  and 
M = the  sample  mean  = 51  Xi 
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Statistics  used  to  show  differences  between  experimental  conditions  tested, 
M,  0,  and  root-niean-square  (RMS),  were  calculated  for  data  along  a segment  of 
each  flight  as  opposed  to  across  flights.  These  M,  a,  and  RMS  values,  repre- 
senting the  performance  of  each  pilot  on  each  flight  were  then  combined  to 
show  differences  between  conditions. 

The  RMS  is  probably  the  best  statistic  to  use  because  it  represents  both 
the  bias  and  the  variability  of  the  error  scores.  It  is  calculated  using  the 
following  formula: 


RMS 


where: 


X.j  = error  measured  at  each  half  mile  along  a segment  of  a flight 
N = number  of  error  scores  along  a segment 

The  analysis  of  variance  test  was  used  to  determine  the  statistical  re- 
liability of  differences  shown  between  experimental  conditions.  Use  of  this 
test  requires  the  assumption  of  normal  distributions  of  scores.  Although  de- 
partures from  normality  of  sample  di stri butions  do  not  necessarily  invalidate 
tne  test,  when  scores  are  known  to  be  samples  from  a non-normal  parent  distri- 
bution, they  should  be  transformed  into  a nonnal  fonii  if  possible  before 
applying  the  test.  Because  RMS  error  scores  are  bounded  by  zero  on  the  lower 
side,  their  distributions  are  skewed  positively  by  an  amount  that  is  readily 
correctable  by  a logarithmic  transformation  of  the  scores.  This  transform- 
ation has  the  effect  of  redistributing  scores  with  a potential  range  from  zero 
to  infinity  over  a new  range  from  minus  to  plus  infinity  and  consistently 
yields  a good  approximation  to  a normal  distribution  of  scores  suitable  for 
analysis  by  any  normal  probability  statistical  technique.  Therefore,  although 
average  RMS  errors  are  presented  in  their  usual  units  of  measurement,  the 
analysis  of  their  variances  were  made  on  their  log  transformed  values. 

The  reliability  of  a statistical  difference  between  two  experimental  con- 
ditions (;t-test),  or  differences  among  more  than  two  conditions  (analysis  of 
variance),  is  expressed  as  the  probability,  £,  that  a difference,  or  differ- 
ences, as  large  or  larger  than  observed  in  the  particular  experimental  samples 
would  be  expected  to  occur  by  chance  if  the  samples  had  been  drawn  at  random 
from  the  same  population.  If  the  prnhahilif.v  of  a chance  occurence  of  the 
observed  difference,  or  differences,  J_s_  less  than  five  times  in  1^0.  {£<(I,_05 ) , 
is  conventional  tp_  cpncj ude_  that,  J;_he  observed  di f f,£reJl££j-  or  differences, 
i statistically  reliable  and  that  the  samples  in  fact  represent  d_iff£r£iiL 
populations.  However,  the  converse  is  not  a valid  conclusion;  the  fact  that 
a sample  difference,  or  differences,  would  be  expected  to  occur  by  chance  five 
times  or  more  in  100  repetitions  of  the  experiment  does  not  indicate  that  the 
samples  necessarily  represent  the  same  population. 


A. 3.0  RESULTS  AND  CONCLUSIONS 

Because  of  two  significant  differences  (i.e.,  no  wind  and  no  distortions 
in  the  presented  horizontal  and  vertical  courses)  between  the  simulated  en- 
vironment of  this  experiment  and  the  environment  generally  seen  in  actual 
flight  operations,  the  results  presented  here  cannot  be  generalized  on  a one 
for  one  basis  to  the  real-world  flight  situation.  However,  the  relative  per- 
formance differences  between  conditions  presented  to  the  pilots  and  demon- 
strated in  the  results  of  this  experiment  should  be  applicable  to  the  real- 
world  flight  situation. 

Three  different  statistical  parameters  will  be  used  to  describe  the  re- 
sults of  this  experiment.  The  mean  (M)  is  used  to  show  tendencies  to  err  on 
one  side  or  the  other  of  the  desired  value.  The  standard  deviation  (a)  will 
be  used  to  show  the  variability  of  the  data  about  the  mean.  The  root-mean- 
square  (RMS)  will  be  used  to  show  performance  differences  between  conditions 
in  which  the  combined  bias  and  variability  effects  are  of  interest. 

A. 3.1  HORIZONTAL  ERROR 

There  are  three  sections  of  the  flight  course  which  provide  data  on  the 
effects  of  turn  anticipation,  waypoint  storage,  and  course  offset  simultaneously. 
These  are  (1)  the  transition  from  the  SID  to  the  STAR  between  Kilo  and  Mike 
waypoints, (2)  the  base  leg  segment  between  Golf  and  Hotel,  and  (3)  the  final 
approach  segment  into  NAFEC.  These  three  sections  will  be  analyzed  both  sep- 
arately and  combined  to  show  performance  differences  among  the  levels  of  the 
independent  variables. 

A. 3. 2 KILO  TO  MIKE 

The  transition  from  the  SID  to  the  STAR  includes  all  of  the  data  from 
two  miles  before  the  Kilo  waypoint  to  five  miles  beyond  the  Mike  waypoint. 

The  flight  task  included  three  left  turns  (91.1,  47.8,  and  97.5  degrees)  with 
straight  courses  between  the  turns.  The  total  distance  covered  in  this  task 
for  each  of  the  five  offsets  was: 


five  miles  left  38.5  nm 
three  miles  left  45.0  nm 
Centerline  54.3  nm 
three  miles  right  62.5  nm 
five  miles  right  68.5  nm 


Pilots  were  to  maintain  level  flight  of  12,000  feet  during  this  task. 

Summaries  of  the  horizontal  error  results  are  presented  in  Table  A. 4, 

Figure  A. 18,  and  Figure  A. 19.  Table  A. 4 presents  summaries  of  the  steady- 
state  data  for  this  portion  of  the  flight  as  a function  of  turn  anticipation, 
waypoint  storage,  and  offset.  Figure  A. 18  presents  average  2 RMS  horizontal 
error  as  a function  of  anticipation  type  and  offset  for  transition  and  steady- 
state  data  on  this  task.  Figure  A. 19  presents  average  2 RMS  horizontal  error 
as  a function  of  waypoint  storage  and  offset  for  transition  and  steady-state 
data  on  this  task.  It  should  be  pointed  out  that  transition  data  is  defined 
as  error  from  two  miles  before  each  waypoint  to  five  miles  beyond  each  waypoint. 
All  other  data  is  defined  as  steady-state. 
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Perhaps  the  most  interesting  aspect  of  the  steady-state  data  presented  in 
Table  A. 4 is  the  magnitude  of  these  errors.  The  average  2o  value  of  0.270 
nautical  miles  for  the  total  combined  steady-state  error  auto  turn  anticipation 
is  far  less  than  the  1.0  nautical  mile  error  previously  assumed  for  steady- 
state  terminal  area  performance.  In  fact  if  performance  using  the  three-way- 
point system  is  ignored,  the  total  average  2o  steady-state  horizontal  error 
■ for  auto  turn  anticipation  is  0.256  nm.  The  offsets  to  the  inside  of  the 

turns  (left)  yield  larger  steady-state  errors  than  centerline  tracking  or  off- 
sets to  the  outside  of  the  turn  (right).  It  should  also  be  pointed  out  that 
steady-state  central  tendency  values  are  to  the  right  of  course  centerline, 

, albeit  the  values  are  very  small. 
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As  one  might  expect,  the  performance  differences  among  the  levels  of  turn 
anticipation,  waypoint  storage,  and  course  offset  are  more  revealing  in  the 
graphs  of  RMS  transition  and  steady-state  error  in  Figures  A. 18  and  A. 19. 

Large  performance  differences  are  indicated  in  Figure  A. 18  between  procedural 
and  auto  turn  anticipation  for  the  transition  data  on  all  offsets.  These 
differences  which  favor  auto  turn  anticipation  are  also  indicated  to  a lesser 
degree  in  the  steady-state  data.  An  analysis  of  variance  revealed  that  the 
differences  between  procedural  and  auto  turn  anticipation  are  statistically 
reliable  (p  <.01 ) for  these  data.  This  result  indicates  that  horizontal 
steering  performance  is  significantly  improved  by  the  use  of  an  automatic  turn 
anticipation  light. 

Figure  A, 19  shows  a consistently  better  performance  for  th e two-wayp o i njt 
system  than  either  the  one  or  the  three-waypoint  systems.  The  one-waypoint 
system  resulted  in  larger  steering  error  for  transition  data,  reflecting  a 
possible  increase  in  workload  in  the  vicinity  of  the  waypoints.  The  three- 
waypoint  system  resulted  in  larger  steady-state  horizontal  steering  error, 
reflecting  the  greater  workload  between  waypoints.  The  analysis  o;^ variance 
showed  that  the  differences  among  the  conditions  of  waypoint  storage  are  sta- 
tistically  reliable  7p  <.05T  for  the  transition  data  but  they  are  not  reliably 
different  for  the  steady-state  data  between  Kilo  and  Mike. 

Finally,  an  examination  of  Figures  A. 18  and  A. 19  reveals  possible  system- 
atic performance  differences  as  a function  of  magnitude  and  direction  of  the 
parallel  course  offset.  Centerline  tracking  yeilds  the  best  performance  for 
both  transient  and  steady-state  data.  In  all  cases  except  the  transient  data 
from  the  two-waypoint  system  performance  dramatically  deteriorates  as  the 
magnitude  of  the  left  offset  (insTde  offseT)  increases.  On  right  offsets 
foutside  offsets!,  performance  deteriorates  and  then  levels  off  as  the  magntiude 
of  the  offset  increases.  The  analysis  of  variance  found  these  results  to  be 
statistically  reliable  (p  <.0iyT 

These  offset  results  are  not  unexpected,  in  the  case  of  procedural  turn 
anticipation,  as  the  magntiude  of  the  offset  increases  on  either  side,  the 
amount  of  uncertainty  concerning  the  correct  anticipation  point  increases. 

This  is  especially  true  for  medium  turns  such  as  at  Lima  and  turns  of  more 
than  90  degrees  such  as  at  Mike.  The  procedural  anticipation  rules  do  not  apply 
as  well  in  these  cases.  The  differences  shown  in  steady-state  conditions  are 
probably  due  to  the  fact  that  inside  offsets  resulted  in  much  shorter  segment 
lengths  which  increased  the  overall  steady-slate  workload.  The  large  differ- 
ences for  transient  data  using  auto  turn  anticipation  are  somewhat  unexpected 
because  the  visual  indication  of  turn  anticipation  was  identical  for 
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Table  A. 4 Central  tendency  and  2o  variability  of  horizontal  error  in 
nautical  miles  for  steady-state  performance  between  Kilo 
and  Mike  as  a function  of  waypoint  storage  and  course  off- 
set for  both  types  of  turn  anticipation.  A negative  sign 
indicates  error  to  the  right  of  course. 


Kilo  to  Mike,  Procedural  Turn  Anticipation: 


WAYPOINT 

STORAGE 

Offset 

One 

TVo 

Combined 

m 

± 2o 

m 

i 2o 

m 

± 2o 

5L 

.027 

.212 

.029 

.256 

-.177 

.838 

-.040 

.436 

3L 

.004 

.144 

-.013 

.216 

.105 

.324 

.032 

.228 

Center 

-.035 

.222 

-.033 

.152 

-.005 

.286 

-.024 

.220 

3R 

-.038 

.180 

-.011 

.184 

-.179 

.390 

-.076 

.252 

5R 

-.012 

.262 

-.038 

.234 

-.020 

.342 

-.023 

.280 

Combined 

-.011 

.204 

-.013 

.208 

-.055 

.4  36 

-.026 

.284 

Kilo  to  Mike,  Auto  Turn  Anticipation; 


WAYPOINT 

STORAGE 

One 

m 

t 2a 

Two 

in  ± 2o 

Three 
m i 2o 

Combined 
m ± 2o 

51. 

-.158 

.382 

.019 

.274 

-.063 

. 220 

-.067 

.292 

31. 

-.078 

.336 

-.008 

.224 

.016 

. 122 

-.023 

.294 

Center 

-.089 

.276 

-.009 

.192 

.056 

.224 

-.014 

.230 

3K 

-.052 

.174 

-.015 

.190 

-.001 

.258 

-.023 

.208 

5R 

-.016 

.202 

.023 

.246 

-.016 

.330 

-.003 

.260 

Combined 

-.079 

.274 

.002 

.226 

-.001 

.270 

-.026 

.256 

AGGKLCAU 

-.045 

.240 

-.006 

.216 

-.028 

.354 

-.026 

.270 
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RVS  HORIZONTAL  ERROR  IN  NMI  c 2 RMS  HORIZONTAL  ERROR  IN  NMI 


OFFSET 

e A. 18  Two  RMS  horizontal  transient  and  steady-state  error  in 

nautical  miles  from  two  miles  before  Kilo  to  five  miles  after  Mike 
as  a function  of  offset  and  turn  anticipation. 


waypoint  STORAGE 


0 


5L 


3L  CENTEH  3R  5R 


OFFSE T 


FigLn-eA,19  Two  RMS  horizontal  transient  and  steadv-state  error  in 

nautical  miles  Iron  two  miles  before  Kilo  to  five  miles  alter  Mike 
as  a function  of  offset  and  waypoint  storage. 


all  offsets.  Apparently  because  of  lack  of  familiarity  with  offset  maneuvers, 
pilots  possibly  were  sur,  ised  by  the  points  where  the  light  told  them  to  turn 
and  responded  differently  in  offset  turns  than  in  centerline  tracking. 

A. 3. 3 BASE  LEG 

The  base  leg  included  all  of  the  data  from  Golf  Waypoint  to  Hotel  way- 
point.  The  flight  task  consisted  of  a 13.1  mile  straight  course  between  90 
degree  left  hand  turns  on  a three-degree  descent  profile  from  6,000  feet  to 
1,930  feet.  Base  leg  offsets  of  three  and  five  miles  were  performed  on 
either  side  of  centerline  simulating  the  "trombone"  delay  maneuver.  Because 
the  turns  at  either  end  of  this  segment  were  90  degrees,  the  length  of  the 
segment  was  the  same  on  all  offsets. 

Summaries  of  the  horizontal  error  results  for  this  segment  are  presented 
in  Table  A. 5,  Figure  A. 20,  and  Figure  A. 21.  Table  A. 5 presents  steady-state 
central  tendency  and  variability  results  and  Figures  A. 20  and  A. 21  present  RMS 
values  of  both  transient  and  steady-state  data.  For  consistency,  transient 
data  are  defined  as  error  measuted  on  the  first  five  miles  and  the  last  two 
miles  of  the  segment.  All  of  th  data  between  these  transient  portions  are 
defined  as  steady-state. 

An  examination  of  Table  A. 5 reveals  a remarkably  good  steady-state  fiori- 
zontal  steering  error  performance  on  offsets  for  all  experimental  conditions 
on  this  30  RNAV  maneuver.  No  2o  variability  scores  were  above  0.300  nautical 
miles.  No  systematic  performance  differences  are  evident  for  the  turn  anti- 
cipation, waypoint  storage,  and  offset  variables  from  these  steady-state  data. 

Figure  A. 20  presents  2 RMS  transient  and  steady-state  horizontal  error  on 
base  leg  as  functions  of  offset  and  anticipation  type.  One  can  see  from  this 
figure  a large  and  systematic  improvement  in  horizontal  tracking  performance 
for  auto  as  compared  with  procedural  turn  anticipation.  An  ana lyji^of  vari- 
ance showed  hojiz^njUl  steering  ^erformajice  for  auto  turn  anticipation  is  re- 
liably better_  th^  the  same  performance  for  procedjpral  turn  anticipation  on 
three-depree  bpse  leg  descents  (p<.05i.  However,  both  procedural  and  auto 
turn  anticipation  techniques  produced  RMS  errors  significantly  less  than  the 
1.0  nm  AC  90-4SA  error  tolerance. 

Figure  A. 21  presents  2 RMS  transient  and  steady-state  horizontal  error 
on  base  leg  as  functions  of  offset  and  waypoint  storage.  This  figure  shows 
there  is  very  little  evidence  of  performance  differences  among  the  three 
levels  of  waypoint  storage  tested.  The  two-waypoint  system  resulted  in  better 
performance  on  three  of  the  offsets  for  both  transient  and  steady-state  data 
but  the  analysis  of  variance  showed  no  reliable  differences  (p  > ,05)  among 
the  levels  of  waypoint  storage  tested. 

Finally,  there  appears  to  be  little  systematic  evidence  from  Figures  A. 20 
and  A. 21  of  performance  differences  among  the  five  offsets  on  base  leg.  In 
some  of  the  cases  centerline  tracking  is  better  than  other  offsets  but  this  is 
not  generally  true.  The  analysis  of  variance  on  these  results  showed  no  re- 
liable horizontal  performance  differences  among  the  base  leg  offsets  (p>  .05) 

A. 3. 4 FINAL  APPROACH 

The  last  data  set  of  the  flight  course  was  made  on  the  30  RNAV  Runway 
Four  approach.  The  task  was  simply  a straight  course  from  a 90  degree  inter- 
cept of  the  inbound  course  to  Juliet  waypoint  located  at  the  approach  end  of 


ANTICIPATION 


■Z 

z 

q: 

o 

a: 

or 

UJ 

_j 

< 

K 

Z 

O 

M 

5 

o 

X 


l.4r 
1.2  - 
1.0  - 
8 - 
6 - 
.4  - 


</^ 

5 

Q:  .2  - 

(\j 


procedural  transient 

AUTO  TRANSIENT 


PROCEDURAL  STEADY  STATE 
AUTO  STEADY  STATE 


0 


5L  3L  center  3R 
OFFSET 


SR 


Figure  A. 20  Two  RMS  horizontal  transient  and  steadv-state  error  in 

nautical  miles  tor  base  leg  between  Coif  and  Hotel  as  functions 
of  offset  and  turn  ant icipat ion . 
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Figure  A. 21  Two  RMS  horiz<»ntal  transient  and  steadv-state  e»ror  ir 

nautical  ft>r  base  lev,  between  r.olf  and  Motel  as  ftjnctioir^ 

of  ottset  and  waypoint  stor.ipe. 
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Table  A. 5 Central  tendency  and  2a  variability  of  horizontal  error 
in  nautical  miles  for  steady-state  performance  between 
Golf  and  Hotel  as  a function  of  waypoint  storage  and 
course  offset  for  both  types  of  turn  anticipation. 

A negative  sign  indicates  error  to  the  right  of  course. 


Golf  to  Hotel,  Procedural  Turn  Anticipation 


WAYPOINT  STORAGE 


Two 

m ± 2a 

.023  .130 

-.065  .136 


3R 


One 

m ± 2o 

-.124 

.122 

-.107 

.154 

-.074 

.268 

-.071 

.206 

-.007 

.202 

-.077 

.190 

Combined 
m ± 


Golf  to  Hotel,  Auto  Turn  Anticipation: 

WAYPOINT  STORAGE 


Center 

3R 

5R 

Combined 


AGGRfGATE 


the  runway.  Task  difficulty  largely  depended  on  the  offset  used  on  base  leg. 
The  most  difficult  case,  the  five  mile  left  offset  on  base  leg,  resulted  in  a 
90  degree  turn  onto  final  at  the  final  approach  fix  six  miles  from  Juliet, 
whereas,  the  least  difficult,  the  five  mile  right  offset  on  base  leg,  resulted 
in  a 90  degree  turn  onto  final  at  16  miles  out.  A guided  three-degree  descent 
from  1,930  feet  to  MDA  (520  feet)  was  initiated  at  the  final  approach  fix.  On 
flights  requiring  the  five  mile  left  offset,  the  turn  onto  final  is  made  while 
continuing  a three-degree  descent.  Other  offsets  required  a level-off  at  1,930 
feet  prior  to  reaching  the  final  approach  fix.  The  final  approach  data  of 
interest  consisted  of  errors  recorded  from  the  final  approach  fix  (six  miles 
from  Juliet)  to  MDA  (0.5  miles  from  Juliet).  The  first  three  miles  of  this 
segment  were  considered  transient  error  and  the  last  2.5  miles  were  considered 
steady-state  error. 

Summaries  of  the  horizontal  error  results  for  final  approach  are  pre- 
sented in  Table  A. 6,  Figure  A. 22,  and  Figure  A. 23.  Table  A. 6 presents  steady- 
state  central  tendency  and  variability  results  and  Figures  A. 22  and  A. 23  pre- 
sent RMS  values  of  both  transient  and  steady-state  error  on  final  approach. 

An  examination  of  Table  A. 6 reveals  how  accurately  pilots  flew  this  30 
RNAV  approach  after  capturing  the  inbound  course.  The  total  2a  variability 
score  of  0.075  is  only  about  five  magnitudes  above  the  bit  size  of  computed 
horizontal  position  on  the  simulator  word.  Comparing  this  data  with  steady- 
state  data  from  the  other  two  tasks.  Tables  A. 4 and  A. 5,  there  is  a consider- 
able final  approach  horizontal  steering  improvement  over  already  very  small 
errors  in  terminal  and  base  leg  tasks. 

The  effects  of  the  base  leg  offset  on  steady-state  horizontal  error  on 
final  approach  is  evident  in  Table  A. 6.  All  but  one  base  leg  offset  resulted 
in  2a  variabilities  considerably  less  than  0.100  nautical  miles.  The  other, 
the  base  leg  five  mile  left  offset,  resulted  in  steady-state  horizontal  steer- 
ing errors  reliably  larger  (p<.05)  than  similar  errors  on  the  other  offsets. 

As  one  would  expect,  the  major  contributing  factor  to  this  result  appears  to 
be  a combination  of  procedural  turn  anticipation  and  a five  mile  left  offset 
on  base  leg.  An  addi tional  factor  was  the  auto  turn  anticipation,  one-waypoint 
storage,  and  five  mile  left  base  leg  offset  combination  of  variables.  Pilots 
apparently  had  no  trouble  on  final  approach  even  after  the  base  leg  five  mile 
left  offset  provided  they  ware  given  the  aid  of  auto  turn  anticipation  and 
two  or  three  waypoint  storage  capacity. 

Figures  A. 22  and  A. 23  provide  additional  evidence  of  these  results  using 
RMS  data.  These  figures  show  large  steady-state  and  transient  error  differ- 
ences between  types  of  turn  anticipation  and  among  levels  of  waypoint  storage 
for  the  five  mile  left  and  the  three  mile  left  offsets  but  no  differences  for 
any  of  the  other  base  leg  offsets.  It  is  also  interesting  to  note  though,  an 
expected  result,  that  transient  and  steady-state  error  data  are  virtually  ident- 
ical for  centerline,  three-right,  and  five-right  base  leg  offsets,  whereas, 
large  differences  exist  between  these  data  sets  and  the  five-left  and  three-left 
base  leg  offsets. 

A. 3. 5 COMPOSITE  DATA 

An  analysis  of  variance  was  made  on  the  composite  of  all  transient  and 
steady-state  RMS  horizontal  error  data  including  that  from  Kilo  to  Mike, 
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Table  A. 6 Central  tendency  and  2o  variability  of  horizontal  error 
in  nautical  miles  for  steady-state  performance  between 
Kilo  and  Mike  as  a function  of  waypoint  storage  and 
course  offset  for  both  types  of  turn  anticipation.  A 
negative  sign  indicates  error  to  the  right  of  course. 


Final  Approach,  Procedural  Turn  Anticipation: 


Base  Leg 
Offset 


WAYPOINT  STORAGE 

Ouc 

m ± 2o 

Two 

m ± 2o 

Three 
m t 2o 

Combined 
m i 2o 

.093  .266  -.046  .132  -.041  .238 
.069  .088  -.082  .048  -.049  .066 
.054  .042  -.056  .048  -.031  .082 


Center  -.054  .042 


-.076  .044  -.054  .044 


Combined  -.005  .100  -.056  .068 


-.032  .032 


-.059  .064  -.039  .064  -.053  .042 


-.042  .092 


Final  Approach,  Auto  Turn  Anticipation: 

WAYPOINT  STORAGL 


Center  -.031  .030 
3K  -.023  .050 
5S  -.02-4  .034 
Combined  -.021  .070 

AGGRIGATE  --O'*  .085 


i 2o 

Two 

m 

i 2o 

Three* 
m 1 2o 

Comb i ned 
m t 2c 

.148 

-.080 

.052 

-.058 

. 064 

-.058 

.088 

.064 

-.057 

.120 

.005 

.054 

-.025 

.080 

.030 

-.029 

.038 

-.030 

.068 

-.030 

. 0*4  h 

.050 

-.010 

.050 

-.04  7 

.064 

-.027 

.05.. 

.034 

-.049 

-.034 

.056 

-.036 

.052 

.070 

-.045 

.06. 

-.033 

.062 

-.035 

.06- 

.085 

-.051 

.065 

-.038 

.077 

-.034 

.075 
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Figure  A. 22  Tvo  RMS  horizontal  transient  and  steady-state*  error  in 

nautical  miles  for  final  approach  as  functionr  of  base  le^  offset 
and  turn  anticipation. 
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Figure  A. 23  Iwn  RMS  horizontal  tra;.  ifnt  and  st  i‘.ui  v-s  t ti  1 1*  rrror  in 

nautical  miles  for  final  approach  as  iunctions  of  base  leg  offset 
and  waypoint  storage. 
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base  leg  and  final  approach.  The  results  of  this  test  follow.  The  overall 
average  2 RMS  horizontal  error  f^r  procedural  turn anticipation  was  ^.502 
JIUJPA  and  for  auto  turn  anticipation  the  result  was  0.352  nauti£al 
miles.  The  probability  of  a chance  occurrence  of  this  result  was  found  to  be 
less  than  0.01.  No  reliable  horizontal  performance  differences  were  found 
among  the  three  levels  of  waypoint  storage  tested  (p  > .05).  The  overall  aver- 
age 2 RMS  horizontal  errors  for  the  five  levels  of  parallel  course  offset  were 
as  follows: 


I  5L  0.550  nm 
i 3L  0.404  nm 

Centerline  0.344  nm 
3R  0.414  nm 
5R  0.422  nm 


The  probability  of  the  occurrence  of  differences  as  large  as  these  is  less 
than  0.01.  Finally,  the  overall  average  2 RMS  horizontal  errors  for  the  five 
flights  made  by  all  pilots  were  as  follows: 

1 0.516  nm 

2 0.402  nm 

3 0.450  nm 

4 0 . 4 1 6 nm 

5 0.352  nm 

The  probability  of  the  occurrence  of  differences  as  large  as  these  is  less 

than  0.01.  - 
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APPENDIX  B 

j AIRLINE  SYSTEM  FLIGHT  TEST  RESULTS 

1 

1 

i The  purpose  of  this  appendix  is  to  present  the  results  obtained  from  the 

airline  system  flight  tests.  The  flight  tests  consisted  of  regularly  scheduled 
airline  flights.  Data  was  collected  in  the  high  altitude  enroute  airspace  as 

1 well  as  in  the  terminal  area.  Onboard  was  an  airline  type  RNAV  system  and  all 

the  necessary  recording  equipment.  For  the  enroute  postion,  the  actual  flight 
path  time  history  was  determined  using  an  inertial  navigation  system  as  a pos- 
ition reference.  In  the  terminal  area,  ARTS  III  radar  data  was  recorded  arid 
merged  with  the  airborne  data. 

The  results  are  presented  for  several  enroute  RNAV  routes  in  both  the 
coupled  and  manual  modes.  The  type  of  aircraft  flown  was  a McDonnel 1 -Dougl as 
DC-10.  This  aircraft  is  normally  flown  in  the  coupled  mode  but  by  request 
several  manual  flights  were  flown  for  data  recording  purposes.  Several  regions 
of  major  VOR  signal  scalloping  were  noted.  These  regions  were  segregated  and 
analyzed  separately  from  those  regions  displaying  minor  scalloping. 

The  primary  statistical  processing  was  done  on  a single  flight  basis. 

The  reduction  included  the  computation  of  means,  variances,  covariances  and 
correlation  coefficients  for  the  various  error  quantities.  Although  insufficient 
data  flights  were  flown  on  any  given  route  to  provide  statistical  significance, 
an  attempt  has  been  made  to  statistically  combine  the  data  across  flights  to  aid 
in  indicating  trends  and  investigate  the  RSS  error  combining  technique  currently 
recommended  in  AC  90-45A  with  =>nd  without  cross  correlation  terms. 

B.l  THE  OPERATIONAL  IMPACT  OF  FTE  IN  HIGjl  ALT ITUDE  ENROUTE  AIRSPACE 

Two  charted  RNAV  roiues  were  flown  in  this  enroute  FTE  investigation. 

These  were  J866R  and  J867R  flown  between  DEN  and  ORD.  The  data  that  was  re- 
corded consisted  of  indicated  aircraft  position  (RNAV  computer  output),  meas- 
ured aircraft  position  (navigation  receiver  output)  and  actual  aircraft  posi- 
tion (inertial  navigation  system  output).  The  actual  aircraft  position 
includes  any  drifts  that  may  exist  in  the  INS  but  this  can  be  extracted  by 
examining  the  aircraft  position  and  INS  position  when  the  aircraft  lands,  for 
example,  or  if  ARTS  III  data  is  recorded.  For  the  most  part,  however,  the  INS 
drifts  were  not  noticably  excessive  in  the  short  flight  from  DEN  to  ORD. 

The  three  recorded  positions  are  used  for  further  analysis  and  statistical 
data  reduction.  The  data  is  presented  in  the  form  of  plots  indicating  the  time 
histories  of  the  various  error  sources  for  each  flight  and  in  summary  tables  of 
statistical  data  reduction  results.  The  plots  and  tables  reveal  the  statistical 
correlation  between  the  error  components. 

B.1.1  Straight  Segment  FTE  and  Accuracy 

Before  examining  the  results  of  the  airline  flight  tests,  it  is  necessary 
to  define  the  various  components  as  they  are  extracted  from  the  data. 

Five  errors  are  defined  in  Figure  B.l.  These  are:  (1)  FTF ; (2)  RNAV  system  or 
navigation  error;  (3)  total  system  error;  (4)  radio  errors  (VOR/DMl  errors); 


and  (5)  computer  errors.  The  last  two  errors  combine  to  make  up  the  RNAV  system 
error.  For  this  particular  study,  only  the  cross  track  components  of  each  of  the 
above  errors  is  of  interest. 
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Figure  B.l  Definition  of  Individual  Error  Components 


Figures  B.2  through  B.5  show  the  results  for  four  data  flights  along  J867R 
between  ORD  and  DEN.  The  results  from  a single  flight  from  DEN  to  ORD  along 
J867R  is  shown  in  Figure  B.6.  Results  for  two  other  flights  along  route  J866R 
from  DEN  to  ORD  are  shown  in  Figures  B.7  and  B.8.  The  order  of  presentation  of 
the  results  starting  at  the  top  of  each  figure  is:  (1)  plot  of  FTE  time  history; 
(2)  plot  of  RNAV  system  cross  track  error  time  history;  (3)  plot  of  total  system 
cross  track  error  time  history;  (4)  plot  of  radio  cross  track  error  time  history; 
and  (5)  plot  of  computer  cross  track  error  time  history. 

The  first  observation  to  be  made  is  the  repeatability  of  the  radio  cross 
track  error.  This  can  particularly  be  observed  by  comparing  the  flight  corre- 
sponding to  2/28/74  to  the  flight  corresponding  to  6/12/74  along  route  J867R  from 
ORD-DEN,  Figure  B.2  and  Figure  B.4.  For  these  two  flights,  all  five  traces  are 
almost  identical  (a  bias  can  be  observed  in  some  of  the  traces  which  is  attrib- 
utable to  the  INS  reference  track).  The  interesting  factor  is  that  there  is  a 
time  span  of  almost  four  months  between  the  two  flights.  Conversations  with  the 
particular  equipment  manufacturers  associated  with  this  flight  test  indicated 
that  the  repeatabi 1 i ty  is  very  common  in  all  of  the  data  flights  and  that  a route 
signature  is  discernable  in  many  cases.  This  would  indicate  that  the  behavior 
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of  the  radio  measurements  is  predictable  and  hence  the  RNAV  system  performance 
is  predictable  along  a given  route.  This  is  clearly  seen  in  the  similarities 
in  the  total  system  cross  track  error  time  history.  The  result  is  contrary  to 
the  result  found  for  general  aviation  equipment  using  ACY  VOR/DMT  (Atlantic 
City)  as  the  test  facility  [8].  There  it  was  found,  through  statistical  data 
reduction,  that  the  radio  measurements  were  not  repeatable  in  any  way. 

The  next  observation  to  be  made  is  the  performance  of  the  airline  level 
RNAV  computer.  A comparison  of  the  radio,  computer  and  RNAV  system  cross 
track  error  time  histories  reveals  the  ability  of  this  particular  airline  com- 
puter to  filter  out  all  but  the  low  frequency  radio  noise.  This  is  particularly 
noticeable  in  observing  that  the  RNAV  system  error  is  almost  exactly  the  mean 
of  the  radio  error.  There  is  a very  slight  lag  but  not  of  sufficient  magnitude 
to  cause  the  bias  effects  characteristic  of  the  general  aviation  computerLB], 

Examine  now  the  FTE  error  trace  in  more  detail.  All  of  the  traces  cor- 
respond to  coupled  flight  with  one  exception.  This  exception  is  the  first  por- 
tion prior  to  the  first  changeover  point  of  the  flight  corresponding  to  6/19/74, 
Figure  B.5  (changeover  points  are  denoted  by  +).  In  this  exception,  the  air- 
craft was  in  the  manual  mode.  The  observation  to  be  made  in  these  figures  is 
that  the  FTE  rarely  exceeds  0.4  nm.  In  those  cases  where  it  does,  evidence  of 
severe  scalloping  is  observed.  Even  in  the  case  of  manual  flight  the  FTE  mag- 
nitude only  momentarily  reaches  a maximum  of  approximately  1 nm.  This  perfor- 
mance is  directly  attributable  to  the  airline  class  RNAV  system  under  inves- 
tigation in  this  study.  Subsequent  statistical  data  reduction  will  further 
substantiate  this  performance. 

Examination  of  the  radio,  RNAV  system  and  total  system  errors  reveals  the 
final  observation  to  be  made  from  the  error  time  histories.  Note  the  simil- 
arities between  the  RNAV  system  and  total  system  errors.  Except  for  discon- 
tinuities in  the  RNAV  system  error,  which  are  observed  to  be  smoothed,  rno  in 
the  total  system  error  due  to  aircraft  dynamics,  the  error  traces  are  almost 
identical.  This  strongly  implies  that  the  total  system  error  enroute  is 
primarily  due  to  unfiltered  radio  errors  in  the  autopilot  mode. 

Table  B.l  presents  the  resul ts  for  flights  flown  in  the  autopilot  mode. 

The  first  observation  to  be  made  is  the  magnitude  of  FTE.  The  means  are  all 
less  than  0.1  nm,  indicating  almost  negligible  bias  effects  and  the  standard 
deviations  are  less  than  0.2  nm  (lo)-  Hence,  a worst  case  mean  plus  2-  error 
would  be  less  than  0.5  nm,  in  fact,  the  flight  corresponding  to  3/5/75  dis- 
plays the  greatest  FTE  of  0.4602  nm  (mean  plus  2a). 

The  flight  test  data  for  four  manual  flights  is  shown  in  Table  B.2.  Two 
comments  should  be  made  regarding  the  manual  results.  First  of  all,  the  por- 
tion of  flight  for  which  manual  data  was  obtained  was  generally  of  short  dura- 
tion. Thus,  random  biases,  which  for  large  numbers  of  samples  will  eventually 
result  in  a zero  mean,  may  be  evident  in  the  results  because  of  the  small  sam- 
ple size.  Secondly,  when  pilots  are  flying  in  the  manual  mode  they  do  not  use 
solely  the  GDI  for  continuous  track  keeping. 
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Table  B.l 


Statistical  Data  Reduction  of 
Flown  in  the  Coupled 


Individual 

Mode 


Airline  Flights 


OtD-^OEN 


J«b7 

z/.’*}  * 

6/4 

6/1? 

6/19 •• 

FTE 

0.0412 

0.0641 

0.0040 

0.0 100 

RNAV 

-0.3051 

-0.2259 

-U.OOl 1 

0.6042 

u 

EQUIP 

-0-4521 

0. 344’ 

•0.1259 

0.5585 

SYSTEM 

-0.26)6 

-0. 1617 

0.0028 

0.6)42 

COMP 

0. 1471 

0.1189 

0.  U46 

0.0457 

FTE 

0.  1428 

0 1551 

0. 1204 

0.089? 

RNAV 

0. 4;09 

0.5540 

0.4025 

0.2409 

0 

EQUIP 

0.  4088 

0.5037 

0.4230 

0.253) 

SYSTSM 

0 4949 

0.6085 

0.448V 

0.2890 

COHP 

0. 3320 

0.38.S 

0. 3043 

0.2550 

riE/fLSV 

0.0151 

0.019’ 

0.0)24 

0 0087 

FTt/ro 

-0.0073 

-0.00') 

-0.0135 

-0.00)6 

nt/sYs 

0.0355 

0.0437 

0.0269 

0.0168 

nE/co*<p 

0.0274 

0.0270 

0.0259 

0.012) 

a 

(LNV/EQ 

0. 1078 

O-20'l 

0.  1041 

0.0236 

RNV/SYS 

0.2094 

0.  3266 

0.1744 

0.0668 

(LW/CO'tP 

0 C565 

0. 1018 

0.0579 

0.0295 

EQ/SYS 

0.  1005 

0.1978 

0.0906 

0.0250 

ry/cnM 

-0.0593 

-0.04S6 

-0.074S 

•0.0)56 

SYS/COM? 

0,  I0b9 

0. 1259 

O.OH38 

0.0418 

nr.7p.sv 

0.2400 

0 . 2 2 9 : 

0.  .'561 

0.4049 

HE/EQ 

-0.1250 

-0.0937 

-0.2655 

-0. 1580 

riE/SYS 

0.5023 

0.46)5 

0.4981 

0,6476 

FTE/COMP 

0.4J0S 

0.4483 

0.5912 

0.5^93 

0 

R.S’V/iQ 

0. 5390 

0.7149 

0.M15 

0 4633 

P-SV/SYS 

0.9600 

0.969  ’ 

O.s'659 

0.9589 

ILSV/COMP 

0 5140 

0.471R 

0 1MSU 

0.479S 

EQ/SYS 

0.  69i>6 

0 6452 

0 (.fit, 

0.3413 

Eo/con? 

-0. 3801 

•0.2*.39 

-0.4854 

-0.55U8 

SYS/COHP 

0. 5763 

0 5459 

0.5129 

0 5669 

ETP 

l.oiso 

0.8377 

0 6916 

0.3532 

R.SAV 

1.9010 

1, 900J 

1 4 906 

1.2763 

IKAXI 

EQUIP 

1 . 3870 

7 1369 

2.1111 

1.39)*, 

SYSTFM 

2.1531» 

2.0254 

1 SH-l 

1.33m« 

COMP 

1.88  70 

2.02)7 

2.0850 

1 . 7874 

— OHO 


JB67 

J876 

6/) 

2/8 

6717 

1/5/75 

)/8775 

ne 

-0.0197 

0.0761 

0-0198 

0.0/52 

0 0429 

mav 

0.254) 

-0,2-89 

-0.7057 

1.2758 

1.4U) 

V 

EOOtP 

0.2424 

-0  28)8 

-0.1976 

1. )087 

1.1982 

STSTfM 

0. 2147 

-0.222$ 

•0. I860 

1.35IO 

1.4560 

COHP 

0-0U9 

-0.0)4S 

-0  01)2 

-0.0))0 

0.7149 

HE 

O.U)4 

0.1515 

0 1577 

0.1975 

0.1614 

ItSAV 

0.)066 

0.4)0) 

0.467} 

0 6517 

0.994J 

o 

FQUIK 

0.3570 

0.6076 

0.4919 

0.9901 

1 0544 

SY5TLM 

0.MJ5 

0.478) 

0.51C6 

0 86)) 

1 0451 

C09P 

0.3B3) 

0.519- 

0 4654 

0 6757 

0.5875 

nE/ANV 

-0.0017 

0.010) 

o.csu 

-0  010- 

0.0)8  7 

nE/?Q 

-0.02716 

-0.0M7 

-0.0^9$ 

0-0974 

-0.0185 

FfE 7ST5 

0.01P9 

0 OJU 

0.0)14 

0 0767 

0.06-S 

nr/criv 

0.01B9 

0.0470 

0.0-09 

0.0570 

0 CS72 

R.SV/EQ 

0.0)7) 

0.142) 

0.1219 

0.648/ 

0 8805 

P.VV/SYS 

0.097) 

0 1955 

0 :794 

0. 7194 

1.077) 

Its'V/COfvP 

0.0568 

0 0429 

0. 0965 

0.0730 

0-1031 

EQ/ACT 

0.016’ 

0.1106 

O.Od 

0.567.5 

0.8670 

EQ/C09 

-0.O902 

-0.2769 

•0.1207 

•0.3215 

-0.7)U 

ACT/CO>*? 

0.0757 

0 0)49 

0. 1)7) 

0 1570 

0 1654 

ne/^yv 

■0  0774 

0 1597 

(i 

-0.06)1 

0 7-17 

rrE/rg 

-0.4077 

-0.3440 

-o.4:i6 

•0  48-5 

•0  108’ 

FTL/SYS 

0.)954 

0.4595 

0 4J12 

0.  1606 

0. )840 

r.E/C'JHf 

0.  );;5 

0 5)i9 

0 6154 

0 6906 

0 •‘6 

ANV/EQ 

0.  3hP4 

0 5-42 

0 5)01 

0 7 794 

0 1P39 

R‘.V/5TS 

0.90)0 

0 9-98 

0.961) 

C.9749 

0 9?9; 

A.SV/COV 

0 4P79 

0.1918 

0.44’6 

0.1)11 

0. l"67 

n/SYS 

0. 1400 

0.36C5 

0. )A74 

0 6‘-.  4 

0. 7P7) 

C3/C0.'<P 

-0  6)91 

-0, 7190 

0 52-5 

-0  5)  99 

0 )’6) 

StS/CoiP 

0.5919 

0.3'*l’ 

0 57?« 

O 7814 

0 7717 

FIE 

0 8101 

0 7082 

0-6)’9 

0 696/ 

0 572S 

ANAV 

0.8990 

1.4010 

1 4199 

) 195h 

5 0199 

|h»«! 

E7UIP 

l.P.'VO 

2.7670 

7.1)89 

4 . 7984 

4 6!07 

srsifjt 

J 99)0 

1 4050 

i 5'17 

) >8)8 

) 0'79 

COMP 

2.0760 

2.7090 

1.8576 

) 7 721 

2 102) 

/Note/ 

* Where  the  year  is  not  given  in  the  flight  identification  it  is 
assumed  to  be  1974. 

**  Does  not  include  manual  portion  of  flight. 
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Table  B.2  STATISTICAL  DATA  REDUCTION  OF  INDIVIDUAL 
AIRLINE  FLIGHTS  FLOWN  IN  THE  MANUAL  MODE 


r 

I 

The  flight  corresponding  to  1/29/75  reveals  the  bias  due  to  the  short 
flight  duration.  Here,  a bias  of  0.5255  nm  can  be  observed.  The  impli- 
cation being  that  during  the  time  of  manual  flight,  the  bias  was  never 
corrected  (this  may  be  due  to  parallax  instrument  error  or  incorrect  readout). 

As  noted  in  Table  B.2,  the  flight  corresponding  to  2/4/75  (column  3 of  Table 
B.2)  was  flown  using  a heading  bug  for  primary  reference  rather  than  the  GDI. 

Hence,  the  FTE  values  are  essentially  meaningless  since  they  are  being  ig- 
nored by  the  pilot  for  track  keeping.  The  results  for  this  particular  fl  ght 
are,  in  a sense,  unsuitable  for  any  subsequent  statistical  data  reduction. 

This  data  does,  in  fact,  represent  one  of  the  FTE  anomalies  identified  in 
i Appendix  A.  Note  the  same  flight  (column  4 of  Table  B.2)  after  the  pilot  was 

j requested  to  use  the  GDI.  The  results  are  observed  to  be  more  consistent 

’ with  the  other  flights  using  the  GDI.  This  data  (column  4)  is  adequate  to  be 

included  in  any  further  statistical  data  reduction. 

In  quantifying  the  manual  FTE  value,  care  must  be  exercised  in  selecting 
the  correct  data  for  the  aforementioned  reasons.  Hence,  the  FTE  numbers  for 
the  flight  corresponding  to  2/4/75  (HDG  Bug)  are  not  to  be  considered.  The 
remaining  five  flights  provide  the  following  mean  i2a  values; 

1 . 068  nm  ] 

1.2266  nm  : 

0.8679  nm  j 

0.2804  nm  (small  sample  size)  ’ 

0.3206  nm 

0.2213  nm  I 

J 

All  of  these  values  are  observed  to  be  well  within  the  4 nm  Task  Force  recom-  j 

mended  value  of  the  current  enroute  region. 

Due  to  the  small  number  of  high  altitude,  enroute  test  flights,  and  due  "j 

to  the  difficulty  in  interpreting  the  meaning  of  data  statistically  combined  u 

using  different  routes  and  navigation  modes  (auto/manual),  it  was  decided  to  ■ 

investigate  error  correlation  effects  in  two  separate  ways.  First  of  all, 
the  lead  and  lag  characteristics  as  well  as  the  similarity  of  the  error 
traces  shown  in  Figure  B.2  through  B.8  suggested  strong  correlation  of  certain 
error  elements  along  a given  flight  path.  Tables  B.l  and  B.2  were  therefore 
developed  to  investigate  the  significance  of  this  correlation  on  a flight  by 
flight  basis.  Secondly,  from  airspace  planning  and  system  compliance  view- 
points, the  only  meaningful  statistics  must  show  the  repeatability  of  RNAV 
system  errors  over  several  flights  on  a given  route.  For  this  reason,  even 
though  Lhe  sample  size  is  analytically  unreliable  as  far  as  prediv;Ling  the 
absolute  accuracy  of  all  airline  quality  systems  with  a 95  probability, 
statistics  were  generated  across  three  comparable  flights  on  a single  route. 

These  cross  flight  statistics  are  useful  to  substantiate  error  correlation 
and  combination  trends  which  can  be  further  investigated  once  a more  meaning- 
ful data  set  is  available. 

The  error  correlations  of  particular  interest  from  the  single  flight  sta- 
tistics in  Tables  B.l  and  B.2  are  the  correlations  of  FTE  with  the  other  error 
components.  In  these  tables,  r represents  the  correlation  coefficietit  where 
r=l  signifies  total  positive  correlation,  .=  -1  signifies  total  negative  corre- 
lation, and  v.=0  signifies  totally  uncorrelated  error  components.  Note  that 
the  correlation  between  FTE  and  the  RNAV  system  is  generally  small,  indicating 
almost  complete  independence  between  these  components  when  statistical 
aggregation  is  done  along  a single  fli(jht.  Between  other  error  components. 


1/29/75  (Ascent) 

1/29/75  (Descent) 

2/04/75  (with  GDI) 

2/07/75 

3/11/75 

3/29/75 
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Figure  B.7  Error  Time  Histories  for  on  Enroute  Autopilot  Flight  From  DEN  to  ORD 

(2/8/74  Using  RNAV  Route  J866R) 
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Figure  B.8  Error  Time  Histories  for  on  Enroute  Autopilot  Flight  From  DEN  to  ORD 

(6/12/74  Using  RNAV  Route  J866R) 
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the  correlation  is  significant  and  should  not  be  ignored  in  the  error  combin- 
ing techniques  applied  in  budget  analysis.  In  particular,  note  the  almost 
perfect  correlation  (p=.96)  between  the  RNAV  system  and  total  system  error 
components.  This  substantiates  what  was  observed  in  the  time  history  plots 
in  that  these  two  traces  were  almost  identical  indicating  the  performance  of 
the  autopilot  in  executing  the  steering  commands.  This  in  fact,  is  the 
primary  cause  of  the  relatively  small  FTE  values.  Also,  as  suspected,  a 
significant  amount  of  negative  correlation  exists  between  the  FTE  and  radio 
error  components.  This  is  oue  to  the  propagation  of  VOR  scalloping  effects 
into  FTE. 

Another  interesting  aspect  of  FTE  is  the  correlation  between  the  total 
system  error  and  the  radio  error.  In  general  , autopilots  are  designed  with 
the  specific  mission  of  nulling  out  position  deviations  from  the  desired 
track  according  to  steering  commands  input  to  the  autopilot.  This  role  of 
the  autopilot  would  imply  that  it  would  more  readily  follow  the  VOR  scallop- 
ing,than  for  example,  a pilot  would.  This  is  borne  out  by  examining  the 
correlation  coefficient  for  the  coupled  and  manual  modes  and  comparing  them. 
Note  the  significant  magnitude  for  the  coupled  mode  indicating  the  aircraft 
response  to  the  autopilot  attempting  to  null  out  scalloping  effects.  Now 
note  the  significantly  reduced  magnitudes  for  the  manual  mode,  especially 
for  the  2/4/75  flight  which  is  ignoring  the  scalloped  signal  by  following 
the  heading  bug. 


Note  also  that  the  correlation  coefficient  between  FTE  and  total  system 
errors  is  significantly  greater  for  the  manual  than  for  the  coupled  mode. 

This  is  attributable  to  the  fact  that  the  threshold  response  level  to  course 
deviation  indications  is  higher  in  the  manual  than  in  the  autopilot  mode 
where  a significantly  larger  portion  of  FTE  would  consist  of  actual  aircraft 
deviations  in  addition  to  the  other  error  sources.  Hence,  the  FTE  component 
will  display  a greater  tendency  to  follow  the  total  system  error. 

Also  of  significance  to  note  is  the  relatively  large  correlation  between 
the  radio  and  computer  error  components.  This  correlation  is  directly  attrib- 
utable to  the  fact  that  the  airborne  computer  is  capable  of  filtering  out 
much  of  the  VOR  noise.  From  the  error  time  histories,  the  observation  was 
made  that  the  computer  was,  in  fact,  able  to  filter  out  all  the  high  frequency 
noise  content. 

B . 1 . 2 Terminal  Area  FTE  and  Accuracy 

This  subsection  presents  the  results  from  the  terminal  area  data  ob- 
tained from  regularly  scheduled  airline  flights  into  O'Hare  Field  (ORD)  in 
Chicago.  The  ARTS  III  radar  track  was  used  to  provide  the  actual  ground 
trace  of  the  aircraft;  where  the  radar  track  was  not  available,  the  INS  track 
was  used.  This  track,  however,  is  subject  to  INS  drift  errors  accumulated 
for  an  entire  flight.  Statistical  FTE  analysis  of  the  terminal  area  data  was 
difficult  due  to  considerable  vectoring  and  other  procedural  actions  requested 
by  ATC.  Due  to  these  consistent  deviations  from  RNAV  track,  the  FTE  data  is 
presented  as  a function  of  time  from  the  initiation  of  the  RNAV  STAR  rather 
than  relative  to  the  amended  track.  However,  the  results  do  indicate  the  be- 
havior of  FTE  during  the  various  ATC  procedures  in  the  t.'rminal  area. 
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The  data  flights  were  flown  from  3/4/75  through  and  each  flight 

contained  impromptu  path  deviations.  Hence,  each  data  flight  represents  a 
single  sample,  and  combination  of  data  for  further  statistical  analysis  can- 
not be  realistically  performed.  For  this  reason  representative  graphical 
results  will  be  presented  for  two  routes  and  statistical  summary  tables  will 
be  presented  on  a route-by-route  basis.  Figure  B.9  presents  the  actual 
ground  track  of  two  terminal  area  flights.  Figure  B.IO  presents  the  FTE  time 
history  corresponding  to  each  of  those  flights.  Some  of  the  procedural  oper- 
ations can  be  observed  in  Figure  B.9.  On  this  flight,  the  captain  was 
instructed  to  proceed  on  a 3 nm  left  parallel  offset,  which  was  then  cancelled 
and  followed  by  a 4 nm  right  offset.  The  resultant  effect  in  FTE  is  shown  in 
Figure  B.IO  where  it  can  be  observed  that  the  offset  magnitudes  are  reflected 
in  the  FTE  magnitude.  (Waypoints  are  indicated  by  the  plus,  +,  symbol  in 
both  Figures  B.9  and  B.IO.)  In  a "Direct-To"  command,  however,  as  shown  in 
the  top  of  Figure  B.IO,  a new  desired  track  is  input  and,  hence,  the  FTE  is 
referenced  to  this  new  track  and  remains  small  as  shown  in  the  lower  half  of 
Figure  B.IO.  Similar  observations  were  made  in  the  remaining  flights.  The 
change  in  reference  track  at  each  wavpoint  was  observed  by  a corresponding 
spike  in  the  FTE  time  history. 

The  primary  observation  made  concerning  FTE  was  that  the  magnitude  re- 
mained relatively  small  for  all  flights.  All  of  these  flights  were  flown  in 
the  autopilot  coupled  mode.  Hence,  the  actual  position  errors  relative  to 
the  desired  track  are  primarily  due  to  the  RNAV  system,  radio  equipment,  and 
autopilot. 

This  last  observation  is  made  clearer  in  the  statistical  data  reduction 
for  each  flight.  This  data  is  presented  in  Table  B.3.  Of  primary  interest 
to  note,  between  the  terminal  and  enroute  statistical  results,  is  that  the 
terminal  results  are  not  as  consistent  across  flights.  This  can  be  attributed 
primarily  to  the  increased  transient  behavior  in  the  terminal  region  wnere 
considerable  maneuvering  is  taking  place.  The  greatest  inconsistencies  be- 
tween flights  exists  in  the  correlation  coefficients.  Not  only  do  the  magni- 
tudes of  the  correlation  coefficients  fluctuate  but  also  the  sign  of  the 
coefficient.  It  would  be  desirable  to  have  an  adequate  number  of  flights 
along  a specified  route  in  order  to  observe  behavior  for  a given  route.  How- 
ever, this  is  beyond  the  scope  of  the  flight  test  data  received  for  the  term- 
inal area. 

Table  B.3  indicates  the  relatively  small  magnitude  of  the  FTE  erro*" 
source  of  the  airline  RNAV  system  operating  in  the  coupled  mode.  With  the 
exception  of  the  flight  corresponding  to  3/4,  the  mean  plus  2o  value  is  ob- 
served to  be  less  than  0.5  nm,  the  largest  being  0.4792  nm  for  the  flight 
dated  3/7.  The  3/4  data  flight  corresponds  to  the  one  shown  on  the  left  half 
of  Figure  B.9.  The  data  reduction  was  performed  for  all  data  except  that 
portion  corresponding  to  the  3 nm  and  4 nm  parallel  offsets.  The  magnitude 
for  FTE  corresponding  to  this  flight  is  questionable  due  to  the  peculiar  be- 
havior of  FTE  on  the  first  segment  considered.  In  the  top  half  of  Figure 
B.IO,  FTE  is  observed  to  be  increasing  linearily  to  more  than  1 nm.  Unfortu- 
nately the  flight  log  does  not  Indicate  what  could  be  the  cause  of  this 
behavior,  hence,  no  provision  could  be  made  for  further  analysis.  In  fact, 
in  almost  all  cases  the  flight  logs  lacked  sufficient  detail  to  perform  an 
adequate  qualitative  analysis. 


'able  B.3  Data  Reduction  of  Individual  Airline  Flights 
Flown  in  the  ORD  Ternnnai  Area 
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ARTS  III  Tracking  not  available,  this  computation  based  on  uncorrected  INS 
STAR:  P=P0PPY1,  PL=PLANT1 , S=ST0CK1 , V=VALLEY1 
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Figure  B.IO  FTE  Time  Histories  - ORD  Terminal  Area 
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With  regard  to  the  correlation  coefficients,  the  noteworthy  observation 
to  be  made  is  the  significant  correlation  between  the  RNAV  system  and  total 
system  errors.  Similar  behavior  was  noted  in  the  enroute  results  and  was 
attributed  to  the  autopilot  capability  to  null  out  the  indicated  errors.  Also 
of  interest  is  the  apparent  increased  correlation  between  all  of  the  error 
components.  This  would  indicate  an  increased  sensitivity  of  combining  errors 
to  the  interdependence  of  the  error  sources  in  the  terminal  area.  The  reason 
for  the  increased  correlation  is  uncertain  other  than  the  increased  sensitiv- 
ities in  the  terminal  area  and  increased  maneuvering. 

Only  two  data  flights  were  obtained  for  the  DEN  terminal  area.  The  ac- 
tual ground  traces  are  shown  in  Figure  B.ll.  For  the  second  flight  (STAR  #2), 
the  ground  traces  are  shown  before  and  after  removal  of  the  INS  drift 
acquired  during  the  enroute  portion  of  the  flight.  Table  6.4  indicates  the 
statistically  reduced  data  for  the  DEN  flights.  For  these  flights  the  mean 
plus  2a  values  are  observed  to  be  0.5629  nm  and  0.5588  nm.  The  correlation 
coefficients  for  these  flights  are  oDserved  to  be  smaller.  This  may  be  due 
to  less  maneuvering  required  for  this  particular  STAR  as  opposed  to  the  ORD 
STAR'S. 

B . 2 THE  RELATIONSHIP  BETWEEN  FTE  AND  AVIONICS  STANDARDS 

The  previous  section  was  limited  to  a presentation  and  discussion  of  re- 
sults on  a single  flight  basis  for  each  of  the  individual  error  components. 

In  this  section,  statistically  combined  results  across  flights  will  be 
presented.  Unfortunately,  only  three  comnon  data  flights  exist  in  the  cur- 
rently available  data  base.  However,  these  combined  results  may  be  used  to 
suggest  plausible  trends  in  relating  FTE  and  avionics  standards  for  airline 
type  RNAV  systems.  These  results  are  separated  into  scalloped  and  non- 
scalloppd  (minor  scalloping^  regions. 

Finally,  error  combining  techniques  are  examined.  Since  correlations  be- 
tween the  various  error  components  have  been  indicated  using  the  single  flight 
analysis, this  information  is  used  to  examine  the  RSS  error  combining  technique 
with  and  without  including  the  covariance  terms. 

B.2.1  RNAV  Equipment  Sophistication  and  FTE 

Table  B.5  presents  the  cross  flight  statistical  data  reduction.  The  sta- 
tistical significance  is  questionable  because  of  the  small  sample  size,  how- 
ever, some  general  observations  can  be  made.  As  would  be  expected,  the  standard 
deviations  in  the  scalloped  region  are  greater  for  all  the  error  components 
than  in  the  region  of  minor  scalloping.  The  statistically  reduced  data  over 
both  regions  is  shown  for  comparison  in  column  3 of  Table  B.5. 

B.2.2  RNAV  System  Errors 

As  indicated  previously  and  presented  in  Tables  B.l  through  B.3,  the 
covariance  and  correlation  coefficients  between  each  of  the  error  components 
have  been  evaluated.  These  quantities  are  now  used  to  indicate  their  useful- 
ness in  combining  the  individual  error  components  in  an  effort  to  estimate 
the  total  system  error.  Without  the  covariance  terms  the  RSS  of  the  individual 
error  components  is. 
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TABLE  B.4 


DATA  REDUCTION  FOR  TWO  DATA  FLIGHTS 
IN  DEN  TERMINAL  AREA 
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Figure  B.ll  DEN  TERMINAL  AREA  FLIGHT  GROUND  TRACES 
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Table  B.5 

Summary  of  Cross  Flight  Statistical  Data  Reduction 
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(1) 


= 

+ 

WHERE 

RNAV  FTE 

°T 

- 

total  system  error. 

°R 

- 

radio  error  (VOR/DME), 

- 

computer  error. 

‘’F 

- 

FTE 

°RNAV 

- 

combined  radio  and  computer  errors 

Including  the  correlation  doefficients , this  expression  becomes: 

Op  0(-  + 2p(^p  op  Op  + 2p(-p  Op  (3) 

WHERE 


p - correlation  coefficient  between  radio  and  computer  errors, 

KC 

PRP  - correlation  coefficient  between  radio  error  and  FTE,  and 
pQP  - correlation  coefficient  between  computer  error  and  FTE. 

Table  B.6  shows  the  results  for  the  nine  flights  between  ORD  and  DEN 
along  routes  J866R  and  J867R.  These  results  are  shown  to  demonstrate  the 
applicability  of  the  above  error  combination  technique  on  a known,  compatible 
data  set  where  the  correlation  must  be  validated  before  attempting  to  aggre- 
gate across  flights  where  more  randomness  is  expected.  The  first  column 
represents  the  standard  deviation  of  the  total  system  error  as  recorded  in 
the  flight  test  data.  The  second  column  represents  the  result  from  applying 
the  RSS  technique  without  the  covariance  terms  (Equation  (1)).  In  this  column 
the  quantities  in  parentheses  represent  using  the  RNAV  system  error  in  place 
of  the  radio  and  computer  errors  individually  in  Equation  (2).  Note  that 
the  RSS  quantities  in  the  parentheses  more  closely  represent  the  total  system 
error  quantities.  This  is  due  to  the  fact  that  in  calculating  the  RNAV  system 
error,  some  of  the  correlations  between  the  various  components  are  inherently 
accounted  for.  Column  3 presents  the  RSS  values  using  the  calculated  co- 
variances  which  precisely  define  the  interdependence  between  the  various  error 
components.  The  final  two  columns  present  the  errors  between  the  two  RSS 
techniques  and  the  total  system  errors  both  numerically  and  on  a percentage 
basis.  The  most  significant  observation  is  the  achievable  accuracy  in  pre- 
dicting the  measured  total  system  errors  on  the  basis  of  the  i ndi v idual  error 
quantities  and  their  associated  covariances. 

Table  B.6  validates  the  precise  statistical  error  combination  technique 
shown  in  equation  form  by  Equation  (3).  These  results  unequivocally  demon- 
strate that  the  error  correlation  illustrated  in  the  time  histories  for  each 
of  the  autopilot  flights  can  be  accounted  for  using  the  specified  covariance 
terms.  Table  B.7  presents  a more  direct  comparison  of  the  accuracies  and  in- 
accuracies attained  using  the  three  levels  of  error  combination  defined  by 
Equations  (1),  (2)  and  (3).  In  a gross  sense  this  table  can  be  interpreted 
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Table  B.6  Comparison  of  Error  Combining  Techniques  for  Coupled  Flight 


RIGHTS 

SYSTEM 
XTRK  ERROR 
O 

ORD-DEN  J867 
2/28 

0.495 

ORD-DEN  J867 
6/4 

0.609 

ORD-DEN  J867 
6/12 

0.471 

ORD-DKN  J867 
6/19 

0.289 

FLIGHTS 

SYSTEM 
XTRK  ERROR 
C 

DES-ORD  J867 
6/3 

0.334 

DE.N-ORD  J866 
2/8 

0.478 

DEN-ORD  J866 
6/12 

0.511 

DEN-ORD  J866 
3/5/75 

0.863 

DEN-ORD  J866 
3/8/75 

1.045 

RSS  WITH 
COVARIANCES 


ERRORS 

DUE  TO 

RSS 

RSS  WITH 
COVARIANCES 

0J33 

26.76% 

(-0.028) 

(-5.68%) 


0,046 

-0.000 

7.53% 

-0.00% 

(-0.033) 

(0.000) 

(-5.47^/c) 

(-O.OO^L) 

0.U7 

0.000 

31 .09®i 

o.ocr.'o 

(-0.024) 

(0.000) 

(-5.08?i) 

(O.ooei) 

0,081 

0.000 

28.16% 

O.CT'c 

(-0.032) 

(-0.000) 

(11.07%)  ! 

(0.084) 

ERRORS 

DUE  TO 

RSS 

RSS  WITH 
CCVA.RIANCLS 

16.29^'^ 

(-0.038) 

(-3.62%) 


-0.000 

-O.OO^c 

(-0.000) 

(-0.0(>‘.) 


0.000 
0 . 00% 
(-0.000) 
(O.OO^c) 
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Table  B.7  Comparative  Results  for  Three  Error  Combination  Techniques 


Fllghh 

8«hwe«o  M«osured  ond  Colculoted  Total  Syttom  F.rrei 
( * meons  colculotad  » meosured) 

Simple  RSS 
EQN  (1) 

RSS  RNAV 
EQN  (2) 

RSS  With 
Cover  ioncei 

ORO-OEN  J867 
2/28 

27% 

-6% 

0% 

ORO-06N  J867 
6/4 

8% 

-5% 

0% 

ORD-OtN  J867 
6/12 

31% 

-5% 

0% 

ORO-OEN  J867 
6/19 

28% 

tl% 

0% 

DEN-ORO  J867 
6/3 

63% 

2% 

0% 

DEN-ORD  J86A 
2/8 

70% 

5% 

O'Jo 

DEN-ORD  J866 
6/12 

36% 

4% 

0% 

DEN-ORD  J866 
3/5 

37% 

1% 

0% 

DEN-ORD  J866 
3/8 

16% 

-4% 

0% 

to  say  that  if  30  to  60%  conservative  estimates  (calculated  greater  than 
measured  total  system  error)  are  adequate  for  system  certification  and  air- 
space planning,  then  the  simple  RSS  technique  can  be  used.  If  more  accurate 
results  are  desired  (+10%),  then  the  RSS  technique  using  just  RNAV  system 
and  FTE  components  is  acceptable.  However,  if  a precise  and  repeatable  method 
for  predicting  total  system  cross  track  errors  is  desired,  then  equation  (3) 
offers  a possible  solution  to  be  verified  across  flights  where  compatibility 
and  correlation  of  radio,  FTE  and  computer  errors  is  not  insured. 

Table  B.8  summarizes  the  results  for  the  manual  flights.  Here  again, 
the  RSS  technique  with  and  without  the  covariance  terms  are  compared  to  the 
recorded  total  system  cross  track  error.  Here  again  the  simple  RSS  is  found 
conservative  by  10  to  30%  except  for  the  heading  bug  flight  which  is  really 
not  applicable.  Also,  the  RSS  RNAV  equation  (2)  results  show  10  to  20, 
conservati sm. 

Again  the  significant  RSS  technique  is  equation  (3).  Including  the  co- 
variance  terms  provides  an  excellent  prediction  of  the  total  system  error 
for  the  autopilot  and  manual  flights  investigated. 
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Table  B.8  Comparison  of  Error  Combining  Techniques  for  Manual  Flights 


PwlGHTS 

ACTUAL 
XTRK  ERROR 
0 

RSS 

0 

RSS  WITH 
COVARIANCES 
0 

ERRORS 

DUE  TO 

RSS 

r:s  wirr 

CUVAkI  V.'.LS 

0.784 

0.862 

C.784 

0.078 

0.000 

SFCVOLS 

(0.623) 

(0.784) 

9.89'. 

0.00  c 

1/29/75 

(-0.1621 

(O.OOOl 

(DESCENT) 

{-20.63'-o) 

O.OO’c 

SFO-Pi:‘< 

0.544 

0.934 

0.544 

0.391 

c.ooo 

1/20/75 

(0.525) 

(0.544) 

71.84-'o 

O.OO-o 

(ASCENT) 

(-0.018) 

(0.000) 

(-3.385.) 

(O.oai) 

ORD-nCN 

1.092 

0.932 

1.092 

-0.159 

-0.000 

2/;/75 

(0.852) 

(1.092) 

-M.60)o 

-O.OCr-c 

(UiinR  Ccca. 

(-0.0240) 

(0.000) 

I'JR.  Bur) 

(-21  .97"l) 

O.OCT'u 

0.637 

1,150 

0.637 

0.513 

0.000 

2/h/75 

(0.575) 

(0.637) 

80.54 

O.OO'b 

(Using  CDl) 

(-0.062) 

(0.000) 

(-9.74:o) 

(0.00  c) 

LAX-OW 

0,205 

0.416 

0.2C5 

0.211 

0.000 

2/7/75 

(0.214) 

(0,205) 

103.02-=t 

0.00  . 

(0.009) 

(-0.000) 

(4.4ff  .^) 

(-0.00'c) 

( ) NUMBER  BASED  ON  0^^^  AND  ONLY 


The  same  principles  and  techniques  were  applied  to  the  cross  flight  data 
as  a gauge  of  the  general  usefulness  of  this  technique.  The  results  of  these 
cases  are  shown  in  Table  B.9,  again,  segregating  the  scalloped  and  non- 
seal  loped  regions  and  then  combining  them.  Although  this  data  represents  only 
three  flights,  the  same  trend  holds  in  that  the  RSS  technique,  including  the 
cross  correlation  terms,  predicts  the  total  system  error  significantly  better 
than  using  the  simple  RSS  technique. 


Table  B.9  Comparison  of  Error  Combining  Techniques  Across  Flights 


cross  fticht 

SYSTEM 

RSS 

0 

R.SS  WITH 

FKKORS 

DUE  TO 

ST.»T!STICS  OF 
2/;S.  6/4,  A 6'12 

XTRK  ERROR 

COVAR lANCE 
0 

RSS 

RSS  WITH 

cnv\;;i  ■> 

0.715 

1.031 

0.715 

0.316 

-0.000 

scal:  oi'iNC 

ARF.A 

(0.714' 

(0.7151 

44 . 1 7 : 
(-0.001) 
(0.18-c) 

-0.0(7 
(-0.0001 
(-0.0(7  1 

0.371 

0.436 

0.371 

0.067 

-0.000 

REGAIN  INC 

AR*> 

(0.357) 

(0.3711 

18.17' 

(-0.C14) 

i ' 

-O.CKT’. 

(-0.0001 

i-o.or. 

OVFRALL 

0.540 

0.657 

(0.520) 

0.540 

(0.540) 

0.116 
21  .M 
(0.020) 
(-37. ?4'L-t 

-0,000 

-0.0C7;w 

(-0.0001 

(-0.00‘c) 

( ) KUMBEP  BASED  OM  O 
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B.3  CONCLUSIONS 

This  section  provides  the  conclusions  of  the  evaluation  of  airline 
quality  RNAV  system  FTE  and  error  combination  techniques.  The  conclusions 
are  listed  for  simple  reference  pertaining  only  to  the  airline  type  RNAV 
system. 

(1)  In  the  autopilot  coupled  mode  in  the  high  altitude  enroute  region, 
the  achieveable  FTE  is  less  than  0.5  nm  (2o). 

(2)  In  the  manual  mode  in  the  enroute  region,  the  achievable  FTE  is 
less  than  1.00  nm  (2o) . 

(3)  Scalloping  significantly  affects  FTE  in  both  autopilot  and  manual 
modes . 

(4)  Error  correlation  between  FTE  and  other  error  sources  is  significant. 

(5)  Excellent  agreement  is  indicated  between  flight  test  recorded  total 
system  error  and  the  quantity  evaluated  using  the  RSS  technique  with 
covariance  terms.  This  technique  should  be  explored  further  using  a 
statistically  meaningful  sample  size. 

(6)  Evaluation  of  RNAV  FTE  and  total  system  accuracy  for  system  compli- 
ance and  airspace  planning  should  only  include  manual  data  when  the 
pilot  is  flying  with  primary  reference  to  the  RNAV  displays.  The 
type  of  accuracies  demonstrated  while  flying  a heading  bug  are 
interesting  to  ATC  and  to  airspace  planning,  but  should  not  be 
included  in  RNAV  statistical  error  evaluations. 

(7)  Airline  quality  RNAV  systems  demonstrate  total  system  accuracies 
enroute  which  are  +1.25  nm  worst  case.  This  is  appreciably  smaller 
than  the  +4.0  nm  allowed  for  enroute  airspace. 
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APPENDIX  C 


MIAMI  OPERATIONAL  FLIGHT  TEST 


C.l  TEST  OBJECTIVES 

This  Flight  Technical  Error  Flight  Test  Program  provided  general  aviation 
FTE  data  in  the  high  density  operational  environment  of  the  Miami  terminal 
area.  The  object’ves  of  the  flight  test  were  designed  to  provide  solutions 
to  these  problem  areas:  1)  validate  the  Task  Force  assumptions  relating  to 
FTE,  2)  determine  FTE  values  and  recommend  values  to  be  used  in  RNAV  error 
budgets  and  3)  provide  quantitative  technical/operational  data  to  substantiate 
FTE  performance  while  executing  Task  Force  RNAV  procedures. 

C.2  TEST  PLAN 

The  basic  test  plan  consisted  of  flying  RNAV  Standard  Terminal  Arrival 
Routes  (stars)  in  the  operational  environment  of  the  Miami  International  Air- 
port. This  location  provided  a high  density  operational  environment  and  ground 
facilities  necessary  to  collect  the  FTE  associated  data  for  the  general  avia- 
tion aircraft/system/crews.  The  tests  were  performed  using  the  single  way- 
point  King  Silver  Crown  2D  KN  74  RNAV  system  and  the  Intercontinental  Dynamics 
Corporation  VNAV  computer  installed  in  a twin  engine  Aero  Commander  500. 

C.3  TEST  PROFILES 

The  test  profiles  flown  are  shown  in  Figures  1 through  3.  They  are  the 
NEW  RIVER  ONE  RNAV  Arrival,  the  PIKE  ONE  RNAV  Arrival  and  the  RNAV  Approach 
to  Runway  9L  o-^  the  Miami  International  Airport,  respectively.  These  test 
profiles  are  ttie  present  Standard  Terminal  Arrival  Routes  (RNAV  STARs)  for 
airline  evaluation  dated  August  10,  1973  and  published  by  the  Jeppesen  Co., 
Denver,  Colorado.  These  charts  meet  FAA  requirements  for  aeronautical  charts. 
For  the  purpose  of  flight  test  data  continuity  and  the  number  of  RNAV  STARs 
planned,  the  low  approaches  to  the  Miami  International  Airport  were  limited 
to  Runway  9L.  Consequently,  flight  tests  for  the  NEW  RIVER  ONE  Arrival  route 
utilized  the  "FROG  Transition"  and  similarly  the  PIKE  ONE  RNAV  Arrival  flights 
utilized  the  "CLUB  Transition". 

C.4  FLIGHT  PROFILE  DESCRIPTION 

A total  of  24  flights  were  flown  for  the  FTE  flight  test  evaluation  in 
the  Miami  International  Airport  terminal  area.  Two  different  RNAV  arrivals 
were  used.  The  NEW  RIVER/FROG  Transition  and  the  PIKE  ONE/CLUB  Transition. 
Three  subject  pilots  participated  during  the  testing.  They  used  the  standard 
Jeppesen  RNAV  charts  of  the  described  RNAV  arrivals,  and  all  required  RNAV 
navigational  information,  i.e.,  bearing,  distance  to  waypoint,  OBS  course, 
etc.,  was  derived  by  the  pilots  from  the  charts.  Tables  C.l  and  C.2  show  the 
distribution  and  description  of  the  routes  flown,  approach  type  and  impromptu 
maneuvers  if  any,  flown  by  the  subject  pilots  during  the  course  of  testing. 

Out  of  a total  ot  24  approaches,  10  were  2D  RNAV  and  14  were  3D  RNAV.  A total 
of  6 impromptu  maneuvers  were  perfoniied,  5 on  the  PIKE  ONE  Arrival  and  1 on 
the  NEW  RIVER  Arrival.  These  impromptu  maneuvers  were  issued  to  the  ()ilot  by 
the  approach  controller. 
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MIAMI  FTE  FLIGHT  PROFILE  DESCRIPTION 


TRANSITION 


IMPROMPTU 


APPROACH 
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DISCUSSION  OF  RESULTS 


The  Flight  Technical  Error  (FTE)  and  airspace  utilization  results  from 
the  Miami  flight  test  program  are  summarized  in  comparison  to  the  Task  Force 
error  budget  values  in  Table  C.3.  In  the  terminal  area  the  FTE  had  a negative 
bias  of  -0.14  nm  and  a 2 sigma  variability  of  '1.08  nm.  This  is  essentially 
the  same  as  the  current  FTE  error  budget  value  (+1.0  nm  for  terminal  operations). 
Similar  statistics  were  obtained  on  the  final  approach.  FTE  was  -0.11  nm 
*0.48  nm.  It  can  be  seen  that  the  proposed  Task  Force  values  were  satisfied 
in  the  approach  operations.  The  lower  half  of  Table  C.3  summarizes  airspace 
utilized  during  execution  of  the  Miami  STARs.  It  can  be  seen  that  the  King/ 

Aero  Commander  combination  successfully  executed  these  RNAV  routes  within  the 
current  protected  airspace  limits.  However,  the  data  also  indicates  accepta- 
bility of  this  type  of  RNAV/ai rcraft  combination  for  Phases  2 and  3. 

Aggregated  statistical  results  from  the  Miami  tests  are  shown  in  Table 
C.4.  Statistical  summaries  for  both  routes  flown  (per  route,  enroute  total, 
approach  total,  per  pilot  and  longest  segment  of  each  route)  are  tabulated  and 
the  results  indicated  in  the  form  of  bias  *;2  sigma.  Following  is  a presenta- 
tion of  FTE  and  protected  airspace  utilization  results  derived  from  the  data. 

Flight  Technical  Error 

• Terminal  area  FTE  satisfied  current  limits  for  all  aggregations 
investigated 

• Final  approach  FTE  may  be  acceptable  throughout  RNAi/  implementa- 
tion (further  statistical  substantiation  is  desirable) 

• FTE  is  apparently  independent  of  pilot  experience  (total  hours) 
for  these  limited  tests 

Airspace  Utilization  (Lateral) 

• Terminal  area  airspace  utilization  is  less  than  anticipated 
protected  airspace  limits  for  all  three  RNAV  implementation 
phases 

• Final  approach  airspace  utilization  is  approximately  0.7  nm 
if  bias  and  2o  variability  are  added 

t Airspace  utilization  is  apparently  independent  of  pilot 
experience  for  these  limited  tests 

The  following  paragraphs  discuss  some  of  the  pilot  procedures  and  RNAV 
equipment  errors  that  contributed  to  the  FTE  magnitudes  experienced  in  the  Miami 
tests.  A review  of  Table  C.5  shows  that  pilots  A and  C,  both  had  a near  equal 
number  of  samples  from  which  statistical  data  was  derived.  However,  pilot  C 
had  a larger  2 sigma  (0.30  nm)  FTE  than  pilot  A.  A data  analysis  review  of  all 
flights  revealed  a consistent  overshoot  during  turns  by  pilot  C.  This  partic- 
ular pilot  would  wait  until  waypoint  passage  to  change  his  OBS  and  then  turn 
the  aircraft  to  its  new  track  heading.  The  turns  performed  by  pilot  C were 
executed  at  shallow  bank  angles  and  less  than  standard  rate  which  would  cause 
the  aircraft  to  be  off  the  desired  track  during  the  overshoots  for  a longer 
period  of  time.  Pilot  A on  the  other  hand,  did  use  procedural  turn  anticipation 
on  all  turns.  The  procedure  was  to  change  the  OBS  as  required  taking  approx- 
imately a 1.0  nm  lead-in  turn  anticipation.  (No  turn  anticipation  procedures 
were  required  of  the  pilots  in  the  Miami  tests.  They  were  told  to  fly  as  they 
would  normally). 
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Table  C.4 


CHAMPLAIN  TECHNOLOGY  INDUSTRIES 
MIAMI  RNAV  FLIGHT  TEST--AGGREOATEO  STATISTICAL  RESULTS 
(Steady  State) 


Total  Along 
Track  Error 

Total  Cross 
Track  Error 

Flight  Technical 
Error 

Nav  Systen 
Track  Error 

N'j-ber 
cf  Points 

? Edited 
Turn  Data 

Mean.2o 

^ear.2o 

*^ean*2ci 

Mear*-2o 

fES  ROL'TE 

1 

Enroute  - New  River/Frog 

0.40:0.56 

0.13:0.68 

-0.11*0.90 

0.24:3.50 

975 

12. 6t 

En'-oute  - Pike/Club 

0.12!0.9« 

0.16-*0.S8 

-0.16*1.16 

0.32^0.72 

1434 

1.37 

LONGEST  SEGMENT  PER  ROUTE 

Enrojte  - Now  River  to  Frog  (22.5  nn) 

0.43*0.60 

0.18--0.6S 

-0.09*0.92 

0.26 *0.44 

711 

8.67 

Er*-0'jte  - BaVe-^  to  Frog  (24.1  n'r) 

0.30‘-0.84 

o.n^o.eo 

-0. 10*1.10 

0.27-0.73 

774 

7.8-. 

PER  PILOT 

Enroute  - A (400  hours) 

0.24  jO. 84 

0.16:0.76 

-0.14:0.92 

0.31^.50 

1103 

3.5T 

Enroute  - B (3000  hours) 

0.27il.l6 

0.05rfl.90 

-0.34:1.50 

0.38^3.90 

333 

4.5% 

En-cute  - C (6500  hours) 

0.22:0.76 

0.16-0.82 

-0.07  -1.02 

0.24  .0.66 

1023 

9.2% 

T0"AL  (All  Routes) 

Te'^inal 

0.23*0.86 

0.15:0.80 

-0.14:1.08 

0.29-0.64 

2469 

6.1-. 

Aporoach 

0.77:0.36 

0.30:0.42 

-0.11  -0.43 

0.41-0.40 

515 

1.3% 

Table  C.5 


CHAMPLAIN  TECHNOLOGY  INDUSTRIES 
MIAMI  RNAV  FLIGHT  TEST--AGGREGATEO  STATISTICAL  RESULTS 
(WORST  CASE) 


Total  Along 
Track  Error 

Total  Cross 
Track  E-^ror 

Flight  Technical 
Error 

Nav  Syste-n 
Track  Error  ' 

Number 

OY  Points  1 

Mean:2? 

‘••ean*2-r 

Mear^Z- 

Mean*2j  , ! 

PER  RO'JT: 

1 

Enroute  - New  River/Frog 

0.39-0.62 

0.08-0.84 

-0.13:1 

08 

0.21*0.53  ! 

1116  1 

Enroute  - Pike/Club 

0. 09*0. 92 

0.13*0.09 

-0.13*1 

28 

0.26*0.78  : 

1513  i 

L0N3ES-  SEG'''"i’  PER  R0L’*E 

1 

r»'ro.>t*'  - New  Riv»r  *o  FroQ  (22.5  "'n) 

0.41*0.54 

C.11-.92 

-0.13*1 

16 

0.24*0.52 

7"8 

Enroute  - Baker  to  Froq  (24.1  n"i) 

0.27*0.88 

0.18-0.82 

-0.04*1 

24 

0.22*0.83  1 

839  : 

pro  pilot 

Enroute  - A (400  hours) 

0.22-0.82 

0.15*0.74 

-0.12*1 

00 

9.27-0.63  j 

1143  j 

Enrout®  - B (3000  hours) 

0.28-1.14 

0.09-0.85 

-0  22-1 

46 

0.31*0.90 

3^4 

Enroute  - C (6500  hours) 

0.18-0.78 

0.03*1. CO 

-c.r*i 

30 

0.20*'^. 74 

1130 

::^A.  ;am  pout"0 

na  * 

0.21*0.86 

0.11-0. 88 

-0.13-1 

20 

0.?4-0.’D 

262? 

Approac*’ 

0.77-0.36 

0.31-0.42 

-0.10*0 

60 

0.41*0  43  ' 

*■22 

In  view  of  the  differences  in  FTE  between  pilots  A and  C based  on  the 
previous  discussion  of  turn  procedures,  it  was  desired  to  compare  the  same 
set  of  statistical  data  for  steady  state  (C.4)  and  worst  case  (C.5).  That 
is,  a controlled  manual  editing  of  data  during  turns.  The  basis  of  this 
editing  was  to  delete  turn  data  whenever  the  pilot  was  trying  to  converge 
to  the  desired  track.  As  it  worked  out,  the  maximum  data  deleted,  because 
of  turns,  was  in  the  segments  2.5  nm  from  the  waypoint  just  passed.  The 
most  significant  FTE  reduction  was  a difference  of  0.28  nm  between  worst 
case  and  steady  state  statistics  on  pilot  C.  Note  the  percent  {%)  of  edited 
data  in  the  pilot's  category  in  Table  C.4.  Pilot  C because  of  his  turn  pro- 
cedures required  9.2%  of  his  turn  data  to  be  edited  vs  pilot  A (3.5%)  and 
pilot  B (4.5%)  who  both  utilized  turn  anticipation  procedures. 

In  the  terminal  area  (all  routes)  the  steady  state  FTE  exhibited  the 
same  negative  bias  of  -0.14  nm  as  in  the  worst  case.  However,  there  was  a 
reduction  of  0.12  nm  (FTE)  2 sigma  variability  while  there  were  no  signifi- 
cant changes  in  the  Total  System  Cross  Track  error  (bias  *2  sigma).  In  ana- 
lyzing the  data  (worst  case  vs  steady  state)  it  was  noted  that  no  significant 
statistical  differences  resulted  from  data  editing.  Histograms  representing 
the  distribution  of  FTE  and  Total  System  Cross  Track  errors  vs  the  frequency 
of  occurrence  are  shown  in  Figures  4 and  5 (worst  case)  and  Figures  6 and  7 
(steady  state).  The  small  impact  of  the  data  editing  is  again  obvious.  Both 
steady  state  and  worst  case  data  sets  are  normally  distributed  with  essentially 
a zero  mean.  The  net  effect  of  editing  was  to  eliminate  outlier  data  and  re- 
duce peakedness  without  adversely  changing  the  demonstrated  variability. 

SUMMARY  OF  OPERATIONAL  RESULTS 

The  FTE  and  airspace  utilization  results  are  shown  graphically  on  Figures 
C.l  through  C.24.  On  each  of  these  figures  is  a summary  of  pertinent  observa- 
tions or  highlights  which  impact  either  the  statistical  analysis  of  the  data 
or  the  operational  procedures  in  the  terminal  area.  The  primary  data  shown 
on  these  figures  consists  of  a solid  black  line  which  indicates  actual  air- 
craft track  as  determined  from  the  ARTS  III  radar  and  a dotted  black  line  which 
is  RNAV  indicated  position  as  measured  by  the  GDI  deflection.  Interpretation 
of  these  traces  is  properly  done  using  the  following  logic.  If  both  the  traces 
are  to  the  left  of  desired  course,  then  the  aircraft  is  actually  to  the  left 
of  desired  course  and  GDI  indications  are  commanding  the  pilot  to  fly  right. 
These  indications  result  in  the  following  sign  convention: 

Actual  position  left  of  course  is  positive 

GDI  fly  right  is  positive 

This  sign  convention  was  used  throughout  the  statistical  data  analysis 
and  reduction. 

The  primary  operational  data  derived  from  the  Miami  flight  test  were 
centered  about  the  following  issues: 

1.  Quanti fication  of  FTE  and  TSGT  errors 

2.  Utilization  of  the  "Direct  To"  Task  Force  procedure 

3.  Evaluation  of  turn  airspace  requirements  for  RNAV  with 
procedural  turn  anticipation  as  opposed  to  no  turn  anticipation 

4.  Evaluation  of  2D  vs  3D  approach  workload  on  FTE 


G-10 


POINTS  . COJNI  IN  UNITS  OF  10  TO  THE  Z POWER  POI M S t COUNT  IN  UNITS  OF  10  10  THE  Z POWER 


Figure  4 Terminal -Total  (Worst  Case)  Figure  5 Terminal -Total  (Worst  Case) 


JOINTS  , COJNI  IN  UNITS  or  10  TO  THE  ? POWER  POINtS  . COUNT  IN  UNITS  Or  10  TO  THE  Z POWER 


Figure  6 Terminal -Total  (Steady  State)  Figure  7 Terminal -Total  (Steady  State) 


5.  Procedural  and  blunder  error  summary 

6.  Analysis  and  definition  of  steady  state  vs  worst  case 
summary  statistics 

7.  Quantification  of  the  impact  and  frequency  of  the  “From-To" 
analog  computer  discontinuity 

8.  Analysis  of  the  workload  involved  with  waypoint  input  and 
the  time  required  for  complete  (p,e)  input 

9.  Determination  of  differences  in  2D  vs  3D  approach  airspace 
and  procedures 

10.  Determination  of  airspace  utilization  as  a function  of 
glideslope  variation. 


Nf^-.  9IVF&  . ^POr-,  M BjfCT 


Milet 


CCOPfff 


9ivrf» 


O «<  •- 

oli 
V O, 
O tJ 
O I 

cx:  ^ ^ 
u-  D “75 
0)  

if  "5 


o ^ 

I 

ST  ^ 


iO 

v*_ 

o 

a. 

CL 

u_ 

o 

O 

-C 

wO 

_C 

o> 

u 

c 

0 

o 

"O 

5 

u 

o 

c 

t/t 

72 

o 

o 

8 

0> 

£ 

D 

D 

O) 

c 

-C 

i- 

a> 

<u 

t/> 

O 

> 

o 

> 

< 

c 

W) 

O) 

c 

0) 

> 

0 

Z 

o 

> 

c 

LU 

o 

> 

D 

V. 

*-  V. 

2^0 

£k: 

,,  I tu  C 

^ ^ o 

o O E 

O O 

° 

<1)  "to 

-C  O C4- 

f-  Q-  O 


>7^CiiDIiG  i^A3E  riLXlilIwNCT  /IIj*'i^D 


f^outieol  *^ll»i 


r 


CO 

z 

o 

7< 

U ^ 

LU 

to 

ca 

o 


o .2 

IZ  “O 

o 

<uo 

Q.U-) 

'O 


V-/ 

o > 

o ^ 

ct:  ^ 
2 


Q) 
O 

^ § 

_ O -D 

O Ji  t; 

• _Q  — 

CN  o “O 


o 

E 


4)  ‘C 


c 

o 


Ql 

o 


“O 

§' 


° 1 
*S 

Z o> 
1/1  -*- 
4)  3 

3 U 
cr  4) 
4)  X 
*-  4^ 

u 


“O  ^ 

i?  . ^ 


0) 

jC 


J 

CN 

04 

go 

O lO 

S s 

O O 

E 

<4-  c«- 

ro'o 

O 

o o 

Si  8 

CO 

CO 

•S-S 

o 

o 

_o  o 

^«L  ^ 

^ 4) 

t 

c 

■*“  c 

o 

V o 

Q ~ 

LJ  O)  *7 

z .E  5 

^ ^ 5 

f::  S 

Qi:  4)  Q 

0«/i  w 
Qu 

Q_  C 

— <u 

O I C 

O 

Ik-  t ^ 
0^0 


n ^ 
O o 

< -5. 

• — ^ M— 

.!2  ^ 

o'-^ 

(_  t-  ro 

E 3 CO 

Q_ 

c “U 

O — 
^ C 

21 
U-  .o 

O S o 

• 0 TJ 

^ o 

c .05 

*-  -C 

^0-4) 

O V) 

< ? 

< o t;: 

“O 

4> 

*• 

o 

2?o 

O TO 

^ T3 

>-  (J> 
*- 

C VI 
4)  4) 

D “O 

S'  <u 

VI  _C 

_Q 

5 o 


o ^ 

— CQ 

^ 'q-O 


CO 


»NAV 


*f'odo.*a  III 


^ o 

\ T3  H- 

CO  C I 

o S 

O I 2 O 
o ^ XI 

O O (y 
u ^ > O 

O ^ o> 

-n  I ? ir' 


rrifiCKDIi'C  hLAHK-UOT  ^IL^iD 


Nfn^tirol  Mil. 


OBSERVATIONS 


x^TifiCCtilDIilCr  X f XLi't.i^D 


580 

♦'^©(iojo  III 


0> 

c 

(D 

o> 


tLATilUMCT 


NISIX-  Ml/.  tivt»  '»Or.,  '.iSJICIC-SDilMt.  iPPBOAC 


HMOWV  AVNi  gc 


r 


U 


tn 

z 

o 

I— 

< 

> 

Cx^ 

LU 

UO 

CO 

o 


• “ c 


0)  r\ 


“D 

o 

o+' 

C w- 

c 

t:  0 

S-.2 

8 -S 


(U  Q 

t£  u 

u-  o "ii 

o *c  12 
.-  ^ 0) 
Q-—  -c 

(1)  o "D 

^ E c 

f—  o o 


£ 

0) 

o 

B ~o 

I/I  c 

o 

-C 

0 

■4— 

c 

on 

o 

> O) 

0) 

E 

Q, 

X 

< 

Q_ 

Z o 

3 

0 C' 

O 

“ 12 

O* 

V S 

-C 

(U  3 

o 

0)  ir 
Q-  £ 
O) 

V) 

j:  O 
-C 

o 

_c 

0)  <D 
'■^  t/> 

v» 

(1) 

O)  o 
•E  ? 

“O 

O)  ^ 

E O 

**" 

vn  -•- 
3 

c 

o 

T3  O 

(D 

-C 

« o 

> 

D a; 

4)  u. 

-E  E 

< 

■ 

0 

-i 

z 

Ctl 

E q: 

0 LU 

C 

0 

0 .5 

o> 

^ > 

VI 

D 

•£  E 

c 

UJ 
2 
D> 

C ^ 

^ < 


O 


0)  -C 

I - 

E 


<u 

o 

c 

0) 

Q- 

X 


o o 

C “D 
O <D  0) 
U T)  > 

c 


«/» 

3 


5 


> 
< 
z 

“O  ^ 


CL  - 


“D 

oi 

D) 

•I  ‘i 


c 

;i  s 

.t: 
c ° 

-S 

12  -c 

T3  -*- 
3 

^ C 

<u 

II 

w> 


c 

<D 

0) 

_Q 


O 

_C 


- > 
< 

O 1 


~u 

0) 


0) 

-O 


o o 
c — 

3^  .2 

*~o 

% 2 

'o 

<U  (1) 

^ I 

£ c 

CL>  (U 
c -C  }^» 
o 3:  8 


0) 


O) 

c 


^ _Q 

I/)  -U 


— o 
0) 
o 
C E 
oi! 
•E  5L 

■*-  VI 
•A 

^ > 

o <; 

c Z 


u 

o 

0 -T3 

0) 

^ L. 

— D 

£ O 

-jC 

^ & 

1 - 
2-8 


e ^ 

D ^ 

U O) 
o c 

= u 

D -^  < 

Si  -o  S 

£ g o 

o1< 

w O < 

(D  v>  ^ 


V 


f^-uiCiDI.G  r^ASfi,  tLAiJK-liOT  f'lLi-liD 


Of  10  /4  MIA  PI  NKjK  Nf»  «|VfR  FROG,  SURJtCI  f 


every 

> 

< 

0> 

-C 

■8 

c 

Z 

E 

oi 

«» 

1 

"D 

-C 

k. 

0) 

E 

o 

0) 

o 

> 

k_ 

«/> 

o 

0) 

U- 

o 

(U 

0) 

' ^ 

k. 

D) 

0 

0) 

u 

c 

-C 

o 

w 

o 

-9 

c 

“O 

Q. 

D 

k. 

*o 

o 

Q. 

0) 

a> 

X 

-C 

£ 

0) 

uuu 

o 

? 

CD 

c 

iO 

X 

lo 

c 

<1> 

m 

^ O o E 

> >.  O)  <D  0) 

< Q.  5^ 

o "2 
« E o .2  > 

.JL.  •—  ^ ^ 

X ^ 4)  < 
V o CL  21 

*/>  Q-  ^ ^ fl. 

4)  Q.  Q.  o ?: 

D ^ O ± 
.-  O 4,  -t  tJ 

- n O’  > 

4)  O C J 
n ^ ° O 

OQ  U_  — — r~ 

U D O ^ 


rl-uiCiiDI.'O  I’AGtE  tLxr^K-UUT  ■f'lLl-l.iD 


Cfl’ 


13 


\ 1.0  nm  "Frorr.-To"  RNAV  discon- 
finuity  was  measured  on  the  atthe 

RNAV  updote  ( P,  = ) FROG 

waypoint 


During  the  RNAV  update  (p,&Mg 
<ROME  the  aircraft  was  on  a 1 3 
j.  . u«nr!ina  from  desired  track  / 

Jiverqmq-neaainy  "v 

however,  at  the  conclusion  of  ^P' 
date  the  pilot  ignored  CDl  fly-nght 
indications  until  the  aircraft  was  ap- 
proximately 2.0  nm  along  track,  ot 
which  time  the  aircraft  head, ng  was 
corrected  (CDl  fly-right  1.0  nm) 


)n  the  BAKER-F  OG  segment  the  NAV 
ystem  error  generally  dim,n,shes  on  the 

O ...  1 r>  J t 1 


80 


MIA  VOR  rodiol 


• »t<j  !«•{.:  f09C(  UA-lf  <15- 

HAfJP80C»  IS  tlMtr'  r 


Figure  C . 13 
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C-14 

OBSERVATIONS 


1)  Excellent  turn  anticipation  was  per- 
formed by  the  pilot  in  the  BAKER  turn 

2)  A 1.0  nm  GDI  differential  "From-To" 

RNAV  discontinuity  occurred  at  the 
FROG  update  ( p , 0) 

3)  At  3.0  nm  after  the  FROG  update,  the 
ATC  requested  and  the  pilot  eu’’ 

a "Direct-To  COOPER"  expect  2000' 

(altitude)  clearance.  An  OBS  track 
heoding  of  195  wos  selected  by  the 

Pi'of  Figure  C.  14 

c AT 

4)  The  1 .5  nm  NAV  system  error  in  the 
"Direct  To"  segment  decreased  as  the 
aircraft  neared  the  COOPER  wavoolnf 


! A . JO  ;.,A.  APFfc, 
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OBSERVATIONS 

1)  A 1.0  nm  CDI  differential  in  the  "From-To"  RNAV 
discontinuity  occurs  in  the  RNAV  update  ( p,  0) 
to  BAKER 

?)  During  the  RNAV  update  (p,  6)  to  FROG,  the 
pilot  inadvertently  Induced  a 10°  - 15°  heading 
change  causing  the  aircraft  to  diverge  further 
right  of  track 

3)  The  pilot  exhibited  good  turn  onticipation  through- 
out the  flight 

0 A significant  reduction  In  the  NAV  system  error 
occurs  on  the  180°  MIA  VOR  radial  due  to  o 
signci  propagation  effect 
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C-16 

OBSERVATIONS 

1)  Large  From-To  RNAV  discontinuities  were  ob- 
served on  the  CDI  at  the  RNAV  update  ( n , 9 ) 
to  FROG  ond  to  MAP 

2)  A reduction  of  the  NAV  system  error  occurs  on  the 
opproximote  180  MIA  VOR  radial  (signal  prope- 
gotlon  effect) 


3) 


A RNAV  discontinuity  2.3  nm  to  MAP  is  observed 
on  most  of  tlie  MIAMI  fliglits 


F igure  C . 16 
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OBSERVATIONS 

This  tesf  is  characterized  by  the  "sinusoidal"  tracks 
of  both  the  RNAV  Guidance  (FTE)  and  actual  air^ 
craft  (ARTS  III)  cross  track  positions  with  respect 
to  the  desired  track  being  flown 


The  safety  pilot  issued  and  the  ATC  approved  an 
impromptu  "Direct-To  COOPER  at  CLUB"  at 
oppnoximately  1 1 .0  nm  to  CLUB 

The  pilot  utilized  heading  control  to  achieve 
"Direct-To"  track,  then  updoted  (p  , 9 ) for 
the  impromptu  wayfX)int 

The  NAV  system  error  diminishes  on  the  180 
^lA  VOR  radial 
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C-18 

OBSERVATIONS 

1)  A 0.6  nm  "From-To"  RNAV  discontinuity  was  ob- 4)  An  interesting  note  is  the  fact  that  the 

served  on  the  CDI  at  the  RNAV  update  ( p,  r ) update  ( p,  d)  "To"  CLUB,  following  a To 

a,  HARRIS  RNAV  Guidance  mode,  exhibits  less  NAV 

system  error  than  an  RNAV  update  in  the  To 

i)  Ti  c RI  p .'j’'.-  U'  I ‘Completed  mode  following  a From"  mode 

1 .5  nm  pa'*  3 'm  FRI  'hod  in  a CDI  fly- 

left  indication  of  nearly  2.0  nm  (2  dots),  5)  RNAV  discontinuity  appears  2.3  nm  to 

wiiile  the  actual  aircraft  [xjsition  was  0.8j  nm  MAP  waypoint 

right  of  the  desired  track 


3)  At  approximately  1 1 -0  ^ ROG,  the 

pilot  was  issued  a "Direct  to  PORTLAND  at 
CLUB".  The  pilot  executed  the  "Direct-To" 
by  RNAV  updating  ( p>  0 ) CLUB 


Figure  C . 18 
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OBSERVATIONS 

1)  The  pilot  consistently  overshoots  his  turns 
because  he  delays  selection  of  the  desired 
OBS  for  the  following  track  until  waypoint 
passage 

2)  A 1 .5  rm  "From-To"  RNAV  discontinuity 
appears  on  the  CDI  following  the  RNAV  up- 
date to  FROG  waypoint 

3)  The  typicol  diminishing  of  the  NAV  system 
error  appears  on  the  180  MIA  VOR  radial 

4)  The  pilots  response  to  needle  deflection  (DOTS) 
results  in  more  accurate  final  approach  (cen- 
tered CDI)  due  to  increased  needle  sensitivity 
(0.25  nm  dot  vs  1 .0  nm  1 dot) 
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In  the  KROME-MAP  segment,  the  pilot  chose  to 
update  his  RNAV  ( p , 9 ) at  COOPER  and  PORT- 
LAND even  though  it  was  not  required  procedure. 

Since  KROME,  COOPER,  PORTLAND  and  MAP  lie 
on  the  some  track  heading,  the  pilot's  decision  only 
increased  his  workload 

The  pilot  commented,  "One  way  of  not  having  to  set 
up  eoch  waypoint  is  to  identify  the  intermediate  woy- 
point  by  woy  of  a DME  fix.  I would  recommend  a 
two  waypoint  RNAV  system  requirement  for  approaches. 

The  differences  between  chart  design  and  equipment  ore 
confusing  in  respect  to  distances  (p)  and  bearings  (9) 
Conventional  RNAV  charts  list  Bearin^/Distance  while 
the  system  tested  had  the  Distance  input  control  head  to 
the  left  of  the  Bearing  input.  This  arrangement  tended 
to  produce  transposition  errors  in  p,  0 Inputs 


me  "From-To"  RNAV  discontinuity  was  observed  3^ 
^ CDI  at  the  RNAV  update  to  FROG 

tAV  system  error  diminishes  on  the  180°  MIA  VOR 
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OBSERVATIONS 


The  pilot  overshot  all  the  turns  due  to  his  del 
in  selecting  the  desired  OBS  for  the  followin 
until  waypoint  passage 

The  NAV  system  error  diminishes  on  the  180° 
VOR  radial 


excessive  Turn  overshoot  at  KROME  was  caused  by  the 
pilot's  flying  technique  and  RNAV  input  procedures. 
Overflying  the  waypoints  prior  to  initiating  the  90° 
turn  onto  final  approach  plus  the  time  required  by 
RNAV  update  (28  sec)  caused  the  test  aircraft  to  inter- 
fere with  the  final  approach  course  to  RAV  9R,  which 
parallelled  the  runwoy  in  use 


i-'fiaCiiDI.'D  tLAllK-IlOT  iTILl-iiD 
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OBSERVATIONS 

The  pilot  consistently  overshot  all  turns  due  *o  lock 
of  turn  anticipation  procedures,  delayed  selection  of 
foMowing  track  heading  and  a small  bonk  angle  (10°- 
15  ) used  during  turns 

The  safety  pilot  issued  and  the  AT C approved  on  im- 
promptu "Direct  to  COOPER  at  CLUB"  at  approximately 
12  nm  to  CLUB.  The  pilot  update  the  RNAV  ( p , u )to 
CLUB  and  then  upon  reach  CLUB,  utilized  the  charted 
OBS  (178  ) for  the  FROG-KROME  segment  and  updated 
the  RNAV  ( p,  i“  ) for  COOPER 


T»  e 
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r JAV  system  error  diminishes  to  near  zero  on  the 
MIA  VOR  radiol 


Figure  C .22 
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observations 

1)  At  approximately  8.0  nm  from  BAKER,  the 
pilot  received  a "Direct-To  Portland  at 
CLUB"  RNAV  clearance.  The  pilot  in- 
itiated execution  by  updating  the  RNAV 

( p,  9 ) to  CLUB.  A 1 .60  nm  "From-To" 
RNAV  discontinuity  was  observed  following 
this  RNAV  update 

2)  The  NAV  system  error  dimlnshes  on  the 
180°  MIA  VOR  radial 

3)  The  PORTLAND  left  turn  was  executed  by 
the  safety  pilot  due  to  Incoming  traffic  on 
R/W  9R  (subject  pilot  C consistently  ovcr^ 
shot  turns  by  os  much  as  1 .0  nm,  thus 
creating  a possible  traffic  conflict) 


4)  An  RNAV  disconti  nuity  occurs  2-3  nm  to 

MAP  waypoint  C-59 


l^igure  C .23 


APPENDIX  D 


DENVER  OPERATIONAL  FLIGHT  TEST 


INTRODUCTION 


The  basic  test  plan  for  this  experiment  consisted  of  flying  RNAV  Standard 
Terminal  Arrival  Routes,  STARs,  in  the  operational  environment  of  the  Stapleton 
International  Airport,  Denver,  Colorado.  This  location  provided  the  operational 
environment  and  ground  facilities  necessary  to  collect  the  desired  Flight  Tech- 
nical Error  and  associated  actual  track  data.  These  tests  were  conducted  in 
conjunction  with  the  United  Airlines  DC-lO/Delco  and  the  NAFEC  G-l/Collins  RNAV 
programs  as  an  integral  part  of  contract  D0T-FA72WA-3098  Technical  Assistance  in 
Airborne  Area  Navigation  Systems.  The  tests  were  performed  using  the  single  way- 
point  KING  Silver  Crown  2D  KN74  RNAV  system  and  the  Intercontinental  Dynamics 
Corporation  VNAV  computer,  installed  in  a twin  engine  Aero  Commander  500. 

Two  subject  pilots  were  required  for  the  purpose  of  these  tests,  one  IFR 
experienced,  the  other  inexperienced.  Test  profiles  were  flown  with  variations 
in  transition  determined  by  the  traffic  flow  in  use,  potential  conflicts  with 
other  terminal  area  traffic,  and  traffic  sequencing  techniques  deemed  necessary 
by  the  controller.  The  subject  pilot  performed  the  navigation  function  and 
handled  all  aircraft  control  and  communications.  The  safety  pilot  monitored 
the  operations  of  the  RNAV  equipment  and  only  intervened  in  situations  that  af- 
fected the  safety  of  the  flight.  The  safety  pilot  was  the  pilot  in  command.  In 
addition,  the  subject  pilot  flew  the  experimental  test  patterns  under  simulated 
IFR  conditions  by  utilizing  a training  hood. 

D.2  TEST  PROFILES 

The  test  flight  profiles  flown  to  the  Stapleton  International  Airport 
are  shown  in  Figures  1 through  6.  These  profiles  were  derived  from  the  Denver 
TRACON  Terminal  Area  RNAV  Design.  Exceptions  were  the  SHAWN  and  TRAIL  ONE  RNAV 
ARRIVALS,  both  to  runway  26L , which  were  published  by  the  Jeppesen  Company,  Den- 
ver Colorado  and  dated  January  25,  1974.  The  RNAV  STARS  flown  were  the  following: 

1.  Trail  One  RNAV  Arrival  / FRED  Transition  (RWY  26L) 

2.  Trail  One  RNAV  Arrival  / GOLF  Transition  (RWY  35) 

3.  Longs  One  RNAV  Arrival  / GOLF  Transition  (RWY  35) 

4.  Shawn  One  RNAV  Arrival  / FRED  Transition  (RWY  26L) 

5.  Trail  (south)  One  RNAV  Arrival  / SLOAN  Transition  (RWY  8R) 

6.  Trail  (north)  One  RNAV  Arrival  / SLOAN  Transition  (RWY  8R) 


D.3  FLIGHT  TEST  DESCRIPTION 

A total  of  18  flights  were  flown  for  the  FTE  flight  test  evaluation  in  the 
Stapleton  International  Airport  terminal  area  in  the  period  from  4-8  August  1974. 
The  subject  pilots  used  the  test  profiles  on  the  previously  described  RNAV  arri- 
vals. All  required  RNAV  navigation  information,  i.e.:  bearing,  distance  to 
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TRAIL  SOUT^^ONE  RNAV  ARRIVAL 
Transition:  Sloan  (P.wy  8R) 
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waypoint,  OBS  course,  altitude  minimums,  etc.,  was  derived  from  the  applicable 
chart.  Tables  D.l  and  D.2  show  the  distribution  and  description  of  the  routes 
flown,  approach  type  and  impromptu  maneuvers,  if  any,  flown  by  the  subject 
pilots  during  the  course  of  testing.  Out  of  a total  of  18  approaches,  9 were 
3D  RNAV  and  9 were  ILS.  A total  of  9 impromptu  maneuvers  (offsets  and  "Direct- 
To")  were  performed.  These  impromptu  maneuvers  were  issued  to  the  pilot  by 
the  ATC  controller.  All  routes  flown  were  simulated  IFR,  prefiled,  and  approved 
by  the  Flight  Service  Station  prior  to  takeoff.  Usually  a request  would  be 
made  to  Flight  Service  to  file  2-3  routes  at  a time.  Each  route  was  terminated 
at  minimum  descent  altitude  except  for  the  last  one  which  was  a full  stop. 

D.4  DISCUSSION  OF  RESULTS 

The  Flight  Technical  Error  (FTE),  and  airspace  utilization  results  from 
the  DENVER  flight  test  program  are  summarized  in  comparison  to  the  Task  Force 
error  budget  values  in  Table  D.3.  In  the  terminal  area  the  FTE  had  a negative 
bias  of  -0.10  nm  and  a 2 sigma  variability  of  -1.0  nm.  This  is  very  close 
to  current  acceptable  limits  for  this  flight  regime.  Similar  statistics  were 
obtained  on  the  final  approach.  FTE  was  -0.17  iO.52  nm.  It  can  be  seen  that 
the  proposed  Task  Force  values  were  satisfactorily  demonstrated  in  the  terminal 
area  operations.  The  lower  half  of  Table  D.3  summarizes  airspace  utilized 
during  <-he  execution  of  the  Denver  STARs.  It  can  be  seen  that  the  KING/ Aero 
Commander  combination  successfully  executed  these  RNAV  routes  within  the  current 
protected  airspace.  However,  the  data  also  indicated  acceptability  of  this 
type  RNAV/ai rcraft  combination  for  Phases  2 and  3. 

Aggregated  statistical  results  from  the  Denver  tests  are  shown  in  Table 
D.4.  Statistical  summaries  for  all  six  routes  flown  (per  route,  enroute  total, 
approach  total  and  offsets)  are  tabulated  and  the  results  indicated  in  the 
form  of  bias  *2o. 

One  of  the  significant  results  illustrated  in  Table  D.4  are  the  parallel 
offset  statistics  which  consist  of  an  aggregation  of  five  different  offsets 
flown;  3 (4.0  nm)  left  offsets  and  2 (4.0  nm)  right  offsets  in  the  enroute 
CDI  sensitivity.  The  Flight  Technical  Error  during  these  maneuvers  is  the  same 
as  for  the  parent  route  tracking.  The  *Za  of  1.04  nm  is  within  acceptable  Task 
Force  limits.  The  FTE  bias  sliows  the  same  negative  direction  and  approximately 
the  same  magnitude  as  the  total  enroute  FTE  statistics.  The  number  of  data 
samples  is  low  (173)  and  more  data  is  needed  before  firm  conclusions  can  be 
made.  However,  these  results  indicate  an  achievable  FTE  consistent  with  the 
Task  Force  requirements  for  parallel  offset  maneuvers. 

Further  analysis  of  Table  D.4  indicates  that  FTE  and  Total  System  Cross 
Track  error  per  route  flown  were  within  the  limits  of  the  Task  Force  (Phases 
2 and  3),  with  the  exception  of  the  TRAIL  ONE  RNAV/GOLF  transition  which  shows 
an  FTE  bias  of  -0.20  and  a *2o  of  1.20  nm.  The  reason  for  this  large  FTE  error 
in  the  TRAIL/GOLF  route  relative  to  the  other  routes  flown  is  the  following: 

A consistent  CDI  deflection  of  2 dots  (2.0  nm)  fly  left  was  observed  after  each 
RNAV  update  (distance  and  bearing)  in  the  BYERS-FRED  segment.  This  error  is 
referred  to  as  a "From-To  Computer  Track  Angle  Discontinuity".  That  is, 
usually,  prior  to  the  RNAV  update  (From  mode)  the  CDI  would  indicate  the  air- 
craft was  on  the  desired  track  but  once  the  RNAV  update  was  completed,  the 


Table  D.2  DENVER  FTE  FLIGHT  PROFILE  DESCRIPTION 


No  arts  III  data  available;  Tapes  were  scratched  du'^ing  data  processing 

No  ARTS  III  data  available;  Flight  test  performed  at  time  of  ARTS  III  tape  changeover 
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CDI  would  indicate  a fly  left  command  up  to  2.0  nm  (2  dots).  The  BYERS-FRED 
segment  was  the  longest  (24.7  nm)  flown  during  the  Denver  tests,  thereby  pro- 
viding a larger  number  of  samples  but  also  the  largest  "From-To  Discontinuity". 
This  particular  error  was  observed  as  well  in  various  segments  of  other  routes. 
The  magnitude  of  the  discontinuity  is  a function  of  track  length  and  large  FTE 
values  can  be  expected  on  long  route  segments  using  the  analog  type  RNAV 
system. 


Turns:  Test  Results 


Figures  0.1  through  D.14  show  the  detailed  flight  path  summaries  of  the 
routes  flown  during  the  Denver  tests.  The  magnitude  of  the  turns  tested 
varied  from  12°  to  135°.  These  turns  were  performed  during  three  different 
types  of  RNAV  procedures:  Standard  (normal  RNAV),  Offsets  and  "Direct-To". 

Table  D.5  summarizes  the  number  of  times  turns  were  performed  In  each  of  these 
RNAV  categories. 


TABLE  D.5  DENVER  TURN  SUMMARY 


TURNS 

STANDARD 

OFFSETS 

DIRECT-TO 

(1)  12°  left 
(1 ) 39°  right 
(1)  55°  left 
(3)  580  right 

(6)  90°  left 

(7)  90°  right 

(2)  55°  left 

(1)  135°  left 

(2)  40°  left 

(1 ) 40°  right 

(1)  115°  right 

A total  of  26  data  turns  were  performed  in  the  Denver  area.  The  subject  pilots 
would  anticipate  the  turns  by  changing  the  DBS  prior  to  the  turn  waypoint  and 
take  approximately  a 1.0  nm  lead-in  turn  anticipation.  This  procedure  although 
not  defined  as  a requirement  of  the  test  plan,  was  adopted  and  executed  by  both 
pilots,  based  on  their  previous  RNAV  experience.  In  the  majority  of  cases, 
the  pilots  would  update  the  RNAV  (p,  e)  while  turning  the  aircraft,  or  within 
2.0  nm  from  the  waypoint  just  passed,  as  the  aircraft  was  being  leveled  off 
from  the  turn.  This  anticipation  procedure,  independent  of  the  RNAV  (p,  e) 
was  highly  successful  in  the  Denver  terminal  area.  In  fact,  if  the  projected 
Task  Force  protected  airspace  limits  (+1.5  nm)  of  any  given  two  consecutive 
track  segments  are  joined  together  at  the  bisector  angle  of  their  respective 
waypoints,  all  turns  performed  in  the  Denver  test  were  within  Task  Force 
boundaries. 

The  number  of  turns  performed  in  the  Denver  test  was  quite  small,  but  these 
results  verify  that  procedural  turn  anticipation  performed  on  the  DTW  RNAV  dis- 
play is  very  effective  and  most  promising.  For  comparison.  Table  D.6  sunniarizes 
turn  overshoot  data  taken  on  the  same  RNAV  system  during  the  RNAV  flight  tests 
at  NAFEC  in  an  experimental  environment.  No  turn  anticipation  procedures  were 
used  during  these  tests.  Out  of  a total  294  turns,  10%  resulted  in  an  overshoot. 
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;i  Certainly,  additional  procedural  turn  anticipation  data  is  needed  to  substan-  1 

tiate  the  results  of  the  Denver  and  NAFEC  tests.  Hopefully,  this  work  may  j 

I result  in  the  introduction  of  the  establishment  of  turn  anticipation  procedures 

r prior  to  introducing  the  decreased  route  widths  projected  as  necessary  by  the 

Task  Force, 
i 

Table  D.7  presents  a detailed  list  of  the  procedural  errors  observed  during 
the  Denver  evaluation  on  a flight  by  flight  basis.  No  blunder  errors  were  re- 
1 corded  in  any  of  these  tests.  A total  of  six  (6)  procedural  errors  were  re- 

corded in  the  Denver  terminal  area.  They  were  equally  distributed  (3  per  pilot) 
and  all  were  related  to  VNAV  and  RNAV  (p,n)  input. 

Summary  of  Operational  Results 

i 

The  FTE  and  airspace  utilization  results  are  shown  graphically  on  Figures 
D.l  through  D.14.  On  each  of  these  figures  is  a summary  of  pertinent  observa- 
tions or  highlights  which  impact  either  the  statistical  analysis  of  the  data 
or  the  operational  procedures  in  the  terminal  area.  The  pri nary  data  shown  on 
these  figures  consists  of  a solid  black  line  which  indicates  actual  aircraft 
track  as  determined  from  the  ARTS  III  radar  and  a dotted  black  line  which  is 
RNAV  indicated  position  as  measured  by  the  GDI  deflection.  Interpretation  of 
these  traces  is  properly  done  using  the  following  logic.  If  both  the  traces 
are  to  the  left  of  desired  course,  then  the  aircraft  is  actually  to  the  left 
of  desired  course  and  GDI  indications  are  commanding  the  pilot  to  fly  right. 

These  indications  result  in  the  following  sign  convention: 

Actual  position  left  of  course  is  positive 

* GDI  fly  right  is  positive  i 

I This  sign  convention  was  used  throughout  the  statistical  data  analysis  and  1 

reduction. 

The  primary  operational  data  derived  from  the  Denver  flight  test  was  : 

centered  about  the  following  issues:  ! 

1)  Quantification  of  FTE  and  TSGT  errors  ^ 

2)  Gomparison  of  centerline  tracking  vs  parallel  offset 
tracking  FTE  and  TSGT  errors 

3)  Analysis  of  procedural  problems  associated  with  parallel  offset 
operatons,  parallel  course  acquisition  and  reacquisition  of 
parent  track 

4)  Turn  overshoot  airspace  utilization  with  procedural  turn  l 

anticipation  r 

5)  ILS  vs  3D  RNAV  approach  accuracy  comparison  ] 

6)  Operational  feasibility  and  accuracy  of  "Direct  To"  maneuvers 

7)  Definition  of  equipment  problems 

8)  Pilot  procedures  (workload)  on  5 nm  base  leg,  and  the 
associated  FTE  and  TSGT  accuracy  typical  of  high  workload 
terminal  area  operations 
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observations 

RS-FRED  From-To  dlsconHnuity  deviation 
»0  nm  (prior -after  RNAV  update)  on  CDI 

rissued  4.0  nm  left  offset  at  8.0  nm  to  FRED 
Jo  overtaking  traffic 

t base  leg  (5.0  nm  PINE -Golf)  coused  heavy 
! workload  and  led  to  one  procedural  error 
I forgot  to  input  the  VNAV  altitude  (7700') 
LF 
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observations 

Excellent  turn  onticlpution  throughout  the  flight 

Short  bose  log  (5  nm)  caused  heovy  pilot  worklood 
end  leod  to  one  procedural  error  {tronsp^ed^ 
bearing  input  dutn  137.4  insteod  of  134.7 

A 1 .0  nm  "F.om-fo"  RNAV  discontinuity  was  re- 
corded  ot  YALE 
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OBSERVAI'IONS 

There  was  yood  turn  anticlpotion  throjyl.out  the 
flight 

A BYERS -FRED  "From -To"  RNA\'  discontinuity 
measuring  1 .5  nm  on  tlie  GDI  s lecorded 

A VNAV  procedural  error  In--*"”d  of  770'^'^ 

to  GOLF  occurred 

The  pilot  hud  the  follov.'ing  comments:  "Using 
VNAV  In  turns  seems  to  keep  tiie  aircroft  too  high, 
since  turn  anticipation  procc.-durts  result  in  the 
aircraft  never  reaching  the  wuyf;oint.  in  a miulti- 
turn  descent  (downwind-base -fir.u  1)  this  situation 
seems  to  escalate,  resulting  in  u continuous  fly- 
dov/n  commend  VNAV  cockpit  procedures  during 
base  leg  result  in  extremely  higli  workload." 
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QbSi:RVAIIONS 

wcs  yocxJ  turn  ant iu ipul !c"i  throu'j!,out  the 


RS-HRED  "Froin-ro"  RNA'/  discor.tinulty 
ring  1 .5  nrn  on  the  CDl  •,  leccr-ied 

\V  procedural  oiror  [n'*-’'-!  cf  770n'\ 

LF  occurred 

lot  hoil  the  follov.'ing  (.i.riments:  "Using 
in  turns  seems  to  heap  the  aircraft  too  hiah, 
urn  cnticipotion  piocio.ircs  result  in  tlie 
t never  leaching  the  waypoint,  in  a multi- 
sscent  (v!ov.nwind-!;cse-fir.al)  this  situation 
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Figure  D.3 
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OBSl.RVAflONS 


A 1 .0  nrn  "I  rorn-To"  I'd  JAV  discon- 


D-4 

OBSEkVAllOtJS 

1;  An  AlC  request  of  a 4.0  nrn  right  offset  Issued  nt 

7.0  nm  to  FRED  was  subsequently  cancelled  at 

5.0  nm  to  FRED  (along  track  distance  from  parent 
route  during  offset  maneuver  vras  5.0  nm) 

2)  At  the  time  of  the  offset  cancellation,  the  CDl 
measurement  was  at  a peak  of  1 .7  nm 
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0 nm  RrsAV  Jiscoi.ti,-,uif/  occuncd  in 
*Fron-To"  B't RS -FkI,  D update 

kTC  request  for  a 4 . ('■  rm  left  offset  issued 
hwing  tl’.e  (p,  5)  upj  do  to  FRED  v<as  per- 
ftd  satisfactorily 
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OBSERVATIONS 

1)  An  ATC  lequest  for  a 4.0  nm  right  offset 
was  issued  at  6.0  nm  to  COAL  but  was 
f^cjncelled  upon  reaching  the  desired  4.0  nm. 
ATC  then  cleared  the  aircraft  for  an  "RNAV 
approach"  to  RWY  26L.  A 135°  heading 
change  was  necessitated  in  order  to  achieve 
the  desired  OBS  track  heading  for  the  COAL- 
FRED  segment 
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OBSLRVATIONS 


1)  4.0  nm  parallel  offset  requested  by  AfC 
after  passing  BYERS 

2)  Waypoint  update  during  45°  parallel  offset 
course  intercept  was  not  good  pilot  procedures 

! 

3)  "From-To"  discontinuity  plus  an  approximately 
1 .0  nm  NAV  system  error  caused  the  actual 
offset  course  to  be  less  than  the  desired4.0nm 

4)  During  transition  back  to  parent  route,  a 


runway  change  was  requested  by  ATC  (26R 


instead  of  26L).  This  was  accomplished  by 
the  pilot  sequencing  from  the  4.0  nm  right 
offset  to  a 1.0  nm  right  offset  (approximate 
parallel  runway  separation) 
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DEN 

6 

Approximate  O.B  nm  NAV  system  error  caused 
actual  final  approach  to  be  closer  to  26L  than 
26R  although  pilots  CDI  indicated  a consistent 

1 .0  nm  offset  course 

^ 

OBj  CSq'i^ 

1 't- . . ‘ lnpi.1 

\ 

\ 

// 

\ 



^— — -***^ FPfp 

-0 

i 


PRSCECDINQ  PA0£  BLANK.1WT  fILM£D 


CFNTftiUNF  4 0 nfn  BIGHT  OFF5FT 


Qjst^RVAnor^ 

An  AT C issuiicl  "Direct-To  GOLF 
wcs  executed  at  13.0  nm  to  rRED. 
The  "Direct-To"  v/us  flown  well 

During  the  VNAV  descent  (10,000 
to  8300’  MSL),  pilot  concentration 
on  3D  profile  resulted  in  excessive 
airspeed  build-up.  The  turn  over- 
shoot upon  intercepting  the  final 
approach  course  was  observed 
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FROM 


SLOAN 


OBSrRVAriONS 


A 1.0  nrn  Trorn-To"  RNAV  discon- 
tinuity v/as  observed  on  tlie  CDl  neur 
tho  OEM  VORTAC  (however,  this  is 
due  to  RNAV  equipment  bias  ond  not 
the  proxitnity  to  the  DEtd  VORTAC) 


A procedural  error  (pilot  selecting 
bearing  input  of  221 .5°  instead  of 
213.3°  for  ^MP)  occured  on  the  ^ 
final  approach  segment,  resulting  in 
a north  of  course  command  from  the 
CDl.  The  pilot  commented  that  "the 
STAN -MAP  v/orklood  was  very  high. 

1 had  almost  no  time  to  crosscheck 
inputs  once  starting  the  turn  at  STAN. 

Downwind-base-final  procedures  using 

VNAV  are  very  demanding". 
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A 1.5  nm  "From-To"  RNAV  discontinuity  was 
rnoosurud  on  the  CDl  following  the  GOAL 
waypoint 
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pBSERVAI  iON^ 

^To"  RNAV  ciisconl-inuity  ut 
^ (P/^  ) to  I KLD  in  the 
Mment  con  be  observed 

for  o "Direct -To"  PINE 

I to  FRED  was  executed  by 
BS  heading  of  220°  and 
' (from  a 10,030' KASL 
\)  into  the  VNAV  altimeter 
irossover  altitude  at  PINE 
id  by  the  pi  lot 
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OBSERVATIONS 
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OBSfiP.VAnONS 

1)  An  obnormal  increase  in  the  P.NAV  nav- 
igational error  occurs  ofter  completion  of 
the  RNAV  update  nt  the  woypoint  change- 
overs  . 

2)  A 1 .5  nm  RNAV  discontinuity  was  observed 
on  the  GDI  at  the  RNAV  "From-To"  update 
at  BYERS  to  FRED 


3)  A ] .0  nm  RNAV  discontinuity  was  observed 
on  the  GDI  at  the  RNAV  "To-To"  upjdate  at 
FRED  to  A/AP 


OBSERVATIONS 


1)  A 4.0  nm  left  offset  v^ci  initiated  by  the 
pilot  (upon  approvol  of  AfC)  6.0  nm  v/est 
of  BYERS 

2)  Large  ARTS  III  datg  dropcots  hinder  a de- 
tailed analysis  of  this  flight 

3)  Upon  Intercepting  the  patent  route,  a 
routine  I LS  approach  was  executed 
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